{
  "cells": [
    {
      "attachments": {},
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/pinecone-io/examples/blob/master/learn/search/hybrid-search/medical-qa/pubmed-splade.ipynb) [![Open nbviewer](https://raw.githubusercontent.com/pinecone-io/examples/master/assets/nbviewer-shield.svg)](https://nbviewer.org/github/pinecone-io/examples/blob/master/learn/search/hybrid-search/medical-qa/pubmed-splade.ipynb)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "oYRaIYfaMWEV",
        "outputId": "460cb6f0-d2a7-4798-8ede-a14da7043217"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "  Installing build dependencies ... \u001b[?25l\u001b[?25hdone\n",
            "  Getting requirements to build wheel ... \u001b[?25l\u001b[?25hdone\n",
            "  Preparing metadata (pyproject.toml) ... \u001b[?25l\u001b[?25hdone\n",
            "  Preparing metadata (setup.py) ... \u001b[?25l\u001b[?25hdone\n"
          ]
        }
      ],
      "source": [
        "!pip install -qU datasets transformers sentence-transformers git+https://git@github.com/pinecone-io/pinecone-python-client.git#egg=pinecone-client[grpc] git+https://github.com/naver/splade.git"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "jDBYM1RUMWEW"
      },
      "source": [
        "## Dataset Preparation\n",
        "\n",
        "We will use the PubMed dataset from Hugging Face Spaces..."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 2,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "hur-NKppMWEW",
        "outputId": "8aebc9b5-909b-4a9f-d1ad-cfd44d5d7d25"
      },
      "outputs": [
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "WARNING:datasets.builder:Found cached dataset pubmed_qa (/root/.cache/huggingface/datasets/pubmed_qa/pqa_labeled/1.0.0/dd4c39f031a958c7e782595fa4dd1b1330484e8bbadd4d9212e5046f27e68924)\n"
          ]
        },
        {
          "data": {
            "text/plain": [
              "Dataset({\n",
              "    features: ['pubid', 'question', 'context', 'long_answer', 'final_decision'],\n",
              "    num_rows: 1000\n",
              "})"
            ]
          },
          "execution_count": 2,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from datasets import load_dataset\n",
        "\n",
        "pubmed = load_dataset(\n",
        "    'pubmed_qa',\n",
        "    'pqa_labeled',\n",
        "    split='train'\n",
        ")\n",
        "pubmed"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 3,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "UQp7SYD0MWEX",
        "outputId": "5292c433-4b63-4f6c-f3e9-eefe4d69dcd8"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "(21645374,\n",
              " {'contexts': ['Programmed cell death (PCD) is the regulated death of cells within an organism. The lace plant (Aponogeton madagascariensis) produces perforations in its leaves through PCD. The leaves of the plant consist of a latticework of longitudinal and transverse veins enclosing areoles. PCD occurs in the cells at the center of these areoles and progresses outwards, stopping approximately five cells from the vasculature. The role of mitochondria during PCD has been recognized in animals; however, it has been less studied during PCD in plants.',\n",
              "   'The following paper elucidates the role of mitochondrial dynamics during developmentally regulated PCD in vivo in A. madagascariensis. A single areole within a window stage leaf (PCD is occurring) was divided into three areas based on the progression of PCD; cells that will not undergo PCD (NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD (LPCD). Window stage leaves were stained with the mitochondrial dye MitoTracker Red CMXRos and examined. Mitochondrial dynamics were delineated into four categories (M1-M4) based on characteristics including distribution, motility, and membrane potential (ΔΨm). A TUNEL assay showed fragmented nDNA in a gradient over these mitochondrial stages. Chloroplasts and transvacuolar strands were also examined using live cell imaging. The possible importance of mitochondrial permeability transition pore (PTP) formation during PCD was indirectly examined via in vivo cyclosporine A (CsA) treatment. This treatment resulted in lace plant leaves with a significantly lower number of perforations compared to controls, and that displayed mitochondrial dynamics similar to that of non-PCD cells.'],\n",
              "  'labels': ['BACKGROUND', 'RESULTS'],\n",
              "  'meshes': ['Alismataceae',\n",
              "   'Apoptosis',\n",
              "   'Cell Differentiation',\n",
              "   'Mitochondria',\n",
              "   'Plant Leaves'],\n",
              "  'reasoning_required_pred': ['y', 'e', 's'],\n",
              "  'reasoning_free_pred': ['y', 'e', 's']})"
            ]
          },
          "execution_count": 3,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "pubmed[0]['pubid'], pubmed[0]['context']"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "mmEGdXitMWEX"
      },
      "source": [
        "We need to cut our contexts into digestable chunks for our models. We'll be using BERT which has a max sequence length of `512` tokens, *but* typical sentence transformers limit this to `128`.\n",
        "\n",
        "To be safe and ensure we're not over the smaller `128` token limit we will assume an average token length of `3` characters (in reality it is more like *3-5*) and therefore our required length will be `128*3 == 384` characters.\n",
        "\n",
        "To build passages of this length we will define a processing function called `chunker`."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 4,
      "metadata": {
        "id": "KOxGZq4-MWEX"
      },
      "outputs": [],
      "source": [
        "limit = 384\n",
        "\n",
        "def chunker(contexts: list):\n",
        "    chunks = []\n",
        "    all_contexts = ' '.join(contexts).split('.')\n",
        "    chunk = []\n",
        "    for context in all_contexts:\n",
        "        chunk.append(context)\n",
        "        if len(chunk) >= 3 and len('.'.join(chunk)) > limit:\n",
        "            # surpassed limit so add to chunks and reset\n",
        "            chunks.append('.'.join(chunk).strip()+'.')\n",
        "            # add some overlap between passages\n",
        "            chunk = chunk[-2:]\n",
        "    # if we finish and still have a chunk, add it\n",
        "    if chunk is not None:\n",
        "        chunks.append('.'.join(chunk))\n",
        "    return chunks"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 5,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "JcJFjKEpMWEX",
        "outputId": "10c2b2e9-29f6-4255-a314-b9ea6fabea27"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "['Programmed cell death (PCD) is the regulated death of cells within an organism. The lace plant (Aponogeton madagascariensis) produces perforations in its leaves through PCD. The leaves of the plant consist of a latticework of longitudinal and transverse veins enclosing areoles. PCD occurs in the cells at the center of these areoles and progresses outwards, stopping approximately five cells from the vasculature.',\n",
              " 'The leaves of the plant consist of a latticework of longitudinal and transverse veins enclosing areoles. PCD occurs in the cells at the center of these areoles and progresses outwards, stopping approximately five cells from the vasculature. The role of mitochondria during PCD has been recognized in animals; however, it has been less studied during PCD in plants. The following paper elucidates the role of mitochondrial dynamics during developmentally regulated PCD in vivo in A.',\n",
              " 'The role of mitochondria during PCD has been recognized in animals; however, it has been less studied during PCD in plants. The following paper elucidates the role of mitochondrial dynamics during developmentally regulated PCD in vivo in A. madagascariensis. A single areole within a window stage leaf (PCD is occurring) was divided into three areas based on the progression of PCD; cells that will not undergo PCD (NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD (LPCD).',\n",
              " 'madagascariensis. A single areole within a window stage leaf (PCD is occurring) was divided into three areas based on the progression of PCD; cells that will not undergo PCD (NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD (LPCD). Window stage leaves were stained with the mitochondrial dye MitoTracker Red CMXRos and examined. Mitochondrial dynamics were delineated into four categories (M1-M4) based on characteristics including distribution, motility, and membrane potential (ΔΨm).',\n",
              " 'Window stage leaves were stained with the mitochondrial dye MitoTracker Red CMXRos and examined. Mitochondrial dynamics were delineated into four categories (M1-M4) based on characteristics including distribution, motility, and membrane potential (ΔΨm). A TUNEL assay showed fragmented nDNA in a gradient over these mitochondrial stages. Chloroplasts and transvacuolar strands were also examined using live cell imaging.',\n",
              " 'A TUNEL assay showed fragmented nDNA in a gradient over these mitochondrial stages. Chloroplasts and transvacuolar strands were also examined using live cell imaging. The possible importance of mitochondrial permeability transition pore (PTP) formation during PCD was indirectly examined via in vivo cyclosporine A (CsA) treatment. This treatment resulted in lace plant leaves with a significantly lower number of perforations compared to controls, and that displayed mitochondrial dynamics similar to that of non-PCD cells.',\n",
              " ' The possible importance of mitochondrial permeability transition pore (PTP) formation during PCD was indirectly examined via in vivo cyclosporine A (CsA) treatment. This treatment resulted in lace plant leaves with a significantly lower number of perforations compared to controls, and that displayed mitochondrial dynamics similar to that of non-PCD cells.']"
            ]
          },
          "execution_count": 5,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "chunks = chunker(pubmed[0]['context']['contexts'])\n",
        "chunks"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "eQODpmMIMWEX"
      },
      "source": [
        "We need to give each chunk a unique ID, like so:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 6,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "EfYHlFBNMWEY",
        "outputId": "2622484e-645d-4be1-98a2-2563eaa0fcc8"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "['21645374-0',\n",
              " '21645374-1',\n",
              " '21645374-2',\n",
              " '21645374-3',\n",
              " '21645374-4',\n",
              " '21645374-5',\n",
              " '21645374-6']"
            ]
          },
          "execution_count": 6,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "ids = []\n",
        "for i in range(len(chunks)):\n",
        "    ids.append(f\"{pubmed[0]['pubid']}-{i}\")\n",
        "ids"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "BmfCmxRKMWEY"
      },
      "source": [
        "We create the full contexts dataset with this logic like so:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 7,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "8_IJJayeMWEY",
        "outputId": "114ff181-f5a9-4afa-d502-0d8d979fb323"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "[{'id': '21645374-0',\n",
              "  'context': 'Programmed cell death (PCD) is the regulated death of cells within an organism. The lace plant (Aponogeton madagascariensis) produces perforations in its leaves through PCD. The leaves of the plant consist of a latticework of longitudinal and transverse veins enclosing areoles. PCD occurs in the cells at the center of these areoles and progresses outwards, stopping approximately five cells from the vasculature.'},\n",
              " {'id': '21645374-1',\n",
              "  'context': 'The leaves of the plant consist of a latticework of longitudinal and transverse veins enclosing areoles. PCD occurs in the cells at the center of these areoles and progresses outwards, stopping approximately five cells from the vasculature. The role of mitochondria during PCD has been recognized in animals; however, it has been less studied during PCD in plants. The following paper elucidates the role of mitochondrial dynamics during developmentally regulated PCD in vivo in A.'},\n",
              " {'id': '21645374-2',\n",
              "  'context': 'The role of mitochondria during PCD has been recognized in animals; however, it has been less studied during PCD in plants. The following paper elucidates the role of mitochondrial dynamics during developmentally regulated PCD in vivo in A. madagascariensis. A single areole within a window stage leaf (PCD is occurring) was divided into three areas based on the progression of PCD; cells that will not undergo PCD (NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD (LPCD).'},\n",
              " {'id': '21645374-3',\n",
              "  'context': 'madagascariensis. A single areole within a window stage leaf (PCD is occurring) was divided into three areas based on the progression of PCD; cells that will not undergo PCD (NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD (LPCD). Window stage leaves were stained with the mitochondrial dye MitoTracker Red CMXRos and examined. Mitochondrial dynamics were delineated into four categories (M1-M4) based on characteristics including distribution, motility, and membrane potential (ΔΨm).'},\n",
              " {'id': '21645374-4',\n",
              "  'context': 'Window stage leaves were stained with the mitochondrial dye MitoTracker Red CMXRos and examined. Mitochondrial dynamics were delineated into four categories (M1-M4) based on characteristics including distribution, motility, and membrane potential (ΔΨm). A TUNEL assay showed fragmented nDNA in a gradient over these mitochondrial stages. Chloroplasts and transvacuolar strands were also examined using live cell imaging.'},\n",
              " {'id': '21645374-5',\n",
              "  'context': 'A TUNEL assay showed fragmented nDNA in a gradient over these mitochondrial stages. Chloroplasts and transvacuolar strands were also examined using live cell imaging. The possible importance of mitochondrial permeability transition pore (PTP) formation during PCD was indirectly examined via in vivo cyclosporine A (CsA) treatment. This treatment resulted in lace plant leaves with a significantly lower number of perforations compared to controls, and that displayed mitochondrial dynamics similar to that of non-PCD cells.'},\n",
              " {'id': '21645374-6',\n",
              "  'context': ' The possible importance of mitochondrial permeability transition pore (PTP) formation during PCD was indirectly examined via in vivo cyclosporine A (CsA) treatment. This treatment resulted in lace plant leaves with a significantly lower number of perforations compared to controls, and that displayed mitochondrial dynamics similar to that of non-PCD cells.'},\n",
              " {'id': '16418930-0',\n",
              "  'context': 'Assessment of visual acuity depends on the optotypes used for measurement. The ability to recognize different optotypes differs even if their critical details appear under the same visual angle. Since optotypes are evaluated on individuals with good visual acuity and without eye disorders, differences in the lower visual acuity range cannot be excluded. In this study, visual acuity measured with the Snellen E was compared to the Landolt C acuity.'},\n",
              " {'id': '16418930-1',\n",
              "  'context': 'Since optotypes are evaluated on individuals with good visual acuity and without eye disorders, differences in the lower visual acuity range cannot be excluded. In this study, visual acuity measured with the Snellen E was compared to the Landolt C acuity. 100 patients (age 8 - 90 years, median 60.5 years) with various eye disorders, among them 39 with amblyopia due to strabismus, and 13 healthy volunteers were tested.'},\n",
              " {'id': '16418930-2',\n",
              "  'context': '100 patients (age 8 - 90 years, median 60.5 years) with various eye disorders, among them 39 with amblyopia due to strabismus, and 13 healthy volunteers were tested. Charts with the Snellen E and the Landolt C (Precision Vision) which mimic the ETDRS charts were used to assess visual acuity. Three out of 5 optotypes per line had to be correctly identified, while wrong answers were monitored.'}]"
            ]
          },
          "execution_count": 7,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "data = []\n",
        "for record in pubmed:\n",
        "    chunks = chunker(record['context']['contexts'])\n",
        "    for i, context in enumerate(chunks):\n",
        "        data.append({\n",
        "            'id': f\"{record['pubid']}-{i}\",\n",
        "            'context': context\n",
        "        })\n",
        "\n",
        "data[:10]"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "NLG6wI9UMWEY"
      },
      "source": [
        "## Model Initialization and Vectors\n",
        "\n",
        "With our dataset prepared we can move on to initializing the required models and setting up some helper functions to make sparse and dense vector building easy.\n",
        "\n",
        "### Dense Vectors\n",
        "\n",
        "Starting with the dense vectors, we will use an off-the-shelf model from the `sentence-transformers` library."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 8,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 522,
          "referenced_widgets": [
            "6ba628998ca240c5bfe4fb21dcd3d9e7",
            "e7fb930778c84d4f9c4306960b4f565e",
            "5c9e8d6733ad461188b01974e04357cd",
            "7917091668aa4f0f849b146b1054b37c",
            "b24cca6c1f6a46c3a79f7a78927aac84",
            "a44201037dfc4a2e9c01fe2900cc13b4",
            "4cb1b687d5a84e7eb649ee76d647e191",
            "1c248783dc014d109e1690bd1d118209",
            "008dafcf3f4d4cdea2913aa0404c3fff",
            "fce9f49dec7b4d699c686d7b4d16f1a9",
            "98ef5f33296d4d80bfc2c1ccd0c18b03",
            "d053563876ea4d7c8d25c88a63df9829",
            "babce43296d24378896c1a3fa4713720",
            "401bf63e5b9d4b91ae39544bd6d38d51",
            "5ca93a5ada074119bf5c6cde3b9d225a",
            "49d309d766474ca7bd6b063bccdc2f07",
            "af3a50e6344e4382aae3741683d92b9b",
            "b9daec2576c8463a9871f4b8216b9689",
            "505038936c104b5eb3fcd833d54d5995",
            "638b7900353b454a9505d0bbfedaab00",
            "302e721a7ad74be38870e336711fce08",
            "b34842fab0164d1394b855050e7c7629",
            "81c773ff410545bbbb213e9581e600b2",
            "0d8be54206934cde81362c3edce7a203",
            "9faa2bee5528421891a9e12db86c9bac",
            "a6f24917244a413c8c817f03bd7791c3",
            "a9fa6be400354573845f92f3e84b0780",
            "d34f209c9fa1454786548522de626dfd",
            "7a6d4b89a7134e90beb0e6935eac8de1",
            "667164d334b040899b99304164c6ed01",
            "ed40c14aee87414798520105749ae4a2",
            "b9e3fb3fda954649a8eac06bc0d3739f",
            "5fad4aa44f16407dab7a6d664e8ac519",
            "0707d55c26a2422b8fc6026977ec375d",
            "8811eb1476a5467a9e31d857938636af",
            "672de802b2dd4cac86df4dbccf2b3447",
            "9b0f15cf08e64b9b964610a51788b005",
            "c7ee3e2badcd438db882c1b3256a696b",
            "f070e8aee0f14c1fb365713486aabfa7",
            "5982dcf51d7f40ae9677e5b9468eade2",
            "c345b55c35ea4ca69ce3e1d4ac6f9dca",
            "e9b0b9d36f2c41d198d37249c2ce76b2",
            "7a347ba2c05f4737b44b252706d723d3",
            "dbbe12f80277472fa1b0e1a64687f26d",
            "c9f0b97472cd407ea18f716b542bf225",
            "705be08a46a340bfb3a8183475ca84a4",
            "5841654c6dbf40b282a5d7359abcbfd5",
            "d06bfaa357bf4719a0ef897619101c56",
            "9f4ff4035e2340cf98e8d4a316dc1fdd",
            "401f51dfdd1b41eb99fb423d31131890",
            "bb299d8a33dc43dd8db2c0e8a52e4975",
            "36353656c0104708877a51120f9d0a25",
            "a94fa31c93d64c06aadab8cb74306623",
            "8dc531d28e574fecbe6faecf88bd6fe3",
            "18cb39937cbc459483be4cbbdc45d3be",
            "75bc1c6846ce490db7eb62592dbd6995",
            "a4e4c78e17f24825852b3e91a8387afd",
            "dc38e44bd7ff4cd7b0167fbc01068881",
            "3a687d3d829a4da3b6cf59d741947229",
            "100ee9c486784b03bab6a7125a82e030",
            "804cc5554212478f8dd594c2a9e49507",
            "ed09d111b20d45438f69f8022c733005",
            "cfa28c0142b04d35952dc53d0b1dba9c",
            "57c3db7d225e4a428e8d9598ff25ecd9",
            "eda56a13387340b99e23c711d402bb74",
            "970f37cbf3544832b72ace0299874ce2",
            "dd6773b4630d409383e8602ee485f7c4",
            "618d0a2a375444a38a3e11bcd093dd74",
            "cca9c1fb2775425db3bb36bbbb3fd310",
            "1dd8820ab04d4f77a5de56954ace800d",
            "4244ebb614e34ad19f5db5349e713b31",
            "53962eaaca764fe6866774a3e0d1df6e",
            "bab2be3bc99841cea55e6fb68ec21531",
            "c358b9b8ee434884a56550f91965e22f",
            "dccca4d25a0a445cbf9431be996439a0",
            "2ebb509f44de4e89a826dfab35b73912",
            "dffb230f3bf44bf999f7ae3ea8cbbf86",
            "ec726dfd105640c2b9e5a4ca55dab8b8",
            "01fa7ac790184cf597c4edef864fa73e",
            "6bd3bcc7f1994bf88ecf0eeba3995646",
            "64401e084e42476cb968dac167e7778a",
            "ca810cd480204fa0bcf7d62e8ffdddea",
            "85cbc3aa2ee24745adc1442f3a15765b",
            "d025a12f92974da4b5ac6a22d5175260",
            "72ed4745dc504191b5bca7da50db8f0f",
            "bcaea55ddaa943bcbe3091aefbbc73d4",
            "8ed2da8d35f543e4aff82f8a0622ad99",
            "9bb05b4768214e3a8291dbecf900cb9b",
            "27065abbc058425fb8688de485fd5938",
            "57c534cfe99a41e6a97bdfa5e39caadb",
            "373441f356d642d98a49fc11de58d27c",
            "e75365b51ed14b0b90a93e261eff249c",
            "2664606eb5634031a4b10b47dfff2439",
            "35692560ec5b4e1082704329b3dbab20",
            "efac14825157470d8008320e1eb509f8",
            "95bb83589a07473c91960eabfe4fe89e",
            "15180c5bcd244dbaa6f24c7078a8a08e",
            "31f3fa86ec214d92818b19916a97e5cb",
            "b029e593f18f4e0586282fc4aaedd320",
            "c781fa3427604455b30eff5b8d342083",
            "c3c37de68162425cbe03a97991492bcd",
            "6b97a667ec864b789f30f9d99b0a20ba",
            "1d341f37095642ff86223b75e63aed12",
            "f1540fcc2eb34c7aa3dd6c5f311e36cd",
            "a357263581434d0eba5828dd57dd39e1",
            "815a6af34b16418895c3fd270c4c594c",
            "2758d0cfb32b4996b6a2738f5c4fe459",
            "68ad6d83eb4943459b6cf6898a45c656",
            "38ee783b28e6420894b6f51855357994",
            "5639c46a9f094f94a3e7df7c7e4344f3",
            "54154b81da834cbc9bf8ccf5ee81d499",
            "ae45bc8a2fbe43679943bd18206c6421",
            "e4f6aa98f3a44fd3a80a2b9c366a6f2f",
            "f128e2ef1c384872812ebb7f112b96c9",
            "6a556aad931647d58a4c5018c6737efd",
            "385292032a63480e85041b6e769e7ce3",
            "2a6ce84338dd4e718aee68ed2681ee84",
            "08a2ffd39fc9426da48c34853b8b9e23",
            "e583a55ffbef4361aed9ce8fdd99eab6",
            "780d138b62af4ad1a1b6589b66f06e34",
            "2e46e31e5e0d4d4797e0cc9677b35e36",
            "997127047843496d9a65733660c8566a",
            "0253e0fb8ba449f1abec1d36b1f56db7",
            "b8fce2cce0ba43e8b7188eb0eed5caf3",
            "d85747a3e1f04591ab99818ca9a07de8",
            "e276fdc557b9414b819dc55aedba3796",
            "661995aa2b3e4ef5b751176e00f55ff2",
            "a4d5c2ce030749ed9e0208b16e539a2f",
            "11c6c75c6db44f83ba80ba68ce32c984",
            "ab18f54679d04352b9aba78976ddfc06",
            "be91e29fcdfd4307a519da3931f6b943",
            "9efb60c3718a44a888ff2146f5a7ae99",
            "f7bb49c411a647eeb806e4ecde1726e1",
            "772e69f9af5a4a4aa9721c9bac340b70",
            "794bc768bbbf481c8ef1d9fc84c46439",
            "f4c22c20e36848acafab7a1021430377",
            "9ee275dcd80947fbad2c3bf510be805a",
            "96b38acbb714419e8e1ac4ec5f168431",
            "3362fdfb00dd4b4982e32b769ec66a70",
            "0480c4cacd9e47b59ffda9eafd36bd08",
            "58344458edd649c5b0ac67882d2dc727",
            "a7253c09584b411e8f5ac4ee7f69f320",
            "248b940a35b244bca04307f8a167eb9d"
          ]
        },
        "id": "g27zKOoaMWEY",
        "outputId": "dc2c78c2-0a5f-414a-a302-194e3a35ad17"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "6ba628998ca240c5bfe4fb21dcd3d9e7",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)8df09/.gitattributes:   0%|          | 0.00/1.18k [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "d053563876ea4d7c8d25c88a63df9829",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)_Pooling/config.json:   0%|          | 0.00/190 [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "81c773ff410545bbbb213e9581e600b2",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)50dc78df09/README.md:   0%|          | 0.00/6.14k [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "0707d55c26a2422b8fc6026977ec375d",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)dc78df09/config.json:   0%|          | 0.00/636 [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "c9f0b97472cd407ea18f716b542bf225",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)ce_transformers.json:   0%|          | 0.00/116 [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "75bc1c6846ce490db7eb62592dbd6995",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)\"pytorch_model.bin\";:   0%|          | 0.00/438M [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "dd6773b4630d409383e8602ee485f7c4",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)nce_bert_config.json:   0%|          | 0.00/54.0 [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "ec726dfd105640c2b9e5a4ca55dab8b8",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)cial_tokens_map.json:   0%|          | 0.00/112 [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "27065abbc058425fb8688de485fd5938",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)8df09/tokenizer.json:   0%|          | 0.00/466k [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "c781fa3427604455b30eff5b8d342083",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)okenizer_config.json:   0%|          | 0.00/461 [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "54154b81da834cbc9bf8ccf5ee81d499",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)df09/train_script.py:   0%|          | 0.00/10.4k [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "997127047843496d9a65733660c8566a",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)50dc78df09/vocab.txt:   0%|          | 0.00/232k [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "f7bb49c411a647eeb806e4ecde1726e1",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "Downloading (…)c78df09/modules.json:   0%|          | 0.00/229 [00:00<?, ?B/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        },
        {
          "data": {
            "text/plain": [
              "SentenceTransformer(\n",
              "  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel \n",
              "  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False})\n",
              ")"
            ]
          },
          "execution_count": 8,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from sentence_transformers import SentenceTransformer\n",
        "import torch\n",
        "\n",
        "device = 'cuda' if torch.cuda.is_available() else 'cpu'\n",
        "# check device being run on\n",
        "if device != 'cuda':\n",
        "    print(\"==========\\n\"+\n",
        "          \"WARNING: You are not running on GPU so this may be slow.\\n\"+\n",
        "          \"If on Google Colab, go to top menu > Runtime > Change \"+\n",
        "          \"runtime type > Hardware accelerator > 'GPU' and rerun \"+\n",
        "          \"the notebook.\\n==========\")\n",
        "\n",
        "dense_model = SentenceTransformer(\n",
        "    'msmarco-bert-base-dot-v5',\n",
        "    device=device\n",
        ")\n",
        "dense_model"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "FRLdvISKMD2j"
      },
      "source": [
        "<small>Note: we are using a model that has not been trained on the pubmed dataset to emulate a real scenario where you have little-to-no data for a use case. If using a model like `multi-qa-mpnet-base-dot-v1` that has seen pubmed before - it can handle this dataset very well and it's harder to see the effect of splade vs no-splade.</small>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "0Q_P4NGPMWEY"
      },
      "source": [
        "We then create an embedding very easily like so:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 9,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "P4rTqJbaMWEY",
        "outputId": "312d945d-51ab-4ae1-d257-608c2600cbd4"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "(768,)"
            ]
          },
          "execution_count": 9,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "emb = dense_model.encode(data[0]['context'])\n",
        "emb.shape"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "1sMXkJqOMWEY"
      },
      "source": [
        "The model returns `768` dimensional dense vectors, this is also reflected in the model attributes."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 10,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "dcX15gf8MWEY",
        "outputId": "ff3f74fa-3f61-4dcd-bab8-487002b49ad0"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "768"
            ]
          },
          "execution_count": 10,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "dim = dense_model.get_sentence_embedding_dimension()\n",
        "dim"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "VIO_JC-wMWEY"
      },
      "source": [
        "### Sparse Vectors\n",
        "\n",
        "We will also need to create sparse vectors. For that we will be using a learned sparse embedding model called SPLADE. SPLADE actually consists of many models that use similar embedding methods, we will be using the `naver/splade-cocondenser-ensembledistil` model.\n",
        "\n",
        "We initialize the model like so:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 11,
      "metadata": {
        "id": "RDklpYdyMWEZ"
      },
      "outputs": [],
      "source": [
        "from splade.models.transformer_rep import Splade\n",
        "\n",
        "sparse_model_id = 'naver/splade-cocondenser-ensembledistil'\n",
        "\n",
        "sparse_model = Splade(sparse_model_id, agg='max')\n",
        "sparse_model.to(device)  # move to GPU if possible\n",
        "sparse_model.eval()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "qoGXjX6uMWEZ"
      },
      "source": [
        "The model takes tokenized inputs that are built using a tokenizer initialized with the same model ID."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 12,
      "metadata": {
        "id": "la2TOhedMWEZ"
      },
      "outputs": [],
      "source": [
        "from transformers import AutoTokenizer\n",
        "\n",
        "tokenizer = AutoTokenizer.from_pretrained(sparse_model_id)\n",
        "\n",
        "tokens = tokenizer(data[0]['context'], return_tensors='pt')"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "dbBHDjfEMWEZ"
      },
      "source": [
        "To create sparse vectors we do:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 13,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "0VbTYUO3MWEZ",
        "outputId": "263a30b4-6ba0-464c-b4ad-30527414b338"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "torch.Size([30522])"
            ]
          },
          "execution_count": 13,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "with torch.no_grad():\n",
        "    sparse_emb = sparse_model(\n",
        "        d_kwargs=tokens.to(device)\n",
        "    )['d_rep'].squeeze()\n",
        "sparse_emb.shape"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 14,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "vZTAuQcwMWEZ",
        "outputId": "44c4a9f2-4cb6-4eb4-82a0-0e0fb32b4c9a"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "tensor([0., 0., 0.,  ..., 0., 0., 0.], device='cuda:0')"
            ]
          },
          "execution_count": 14,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "sparse_emb"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "f6N-4wPFMWEZ"
      },
      "source": [
        "Leaving us with a `30522` dimensional sparse vector embedding. Pinecone will expect a dictionary style format of the sparse vector. To build it we take a couple more steps.\n",
        "\n",
        "First we get a list of non-zero positions in the vector."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 15,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "CqHF7K_iMWEZ",
        "outputId": "763f8f04-10a1-4079-d238-6d31d0360b26"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "173\n"
          ]
        }
      ],
      "source": [
        "indices = sparse_emb.nonzero().squeeze().cpu().tolist()\n",
        "print(len(indices))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "aZr-MYUWMWEZ"
      },
      "source": [
        "We have `174` non-zero values, we use them to create a dictionary of index positions to scores like so:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 16,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "RQP0hFPEMWEZ",
        "outputId": "7d913dab-5833-4e9b-c556-432831fc4976"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "{'indices': [1000,\n",
              "  1039,\n",
              "  1052,\n",
              "  1997,\n",
              "  1999,\n",
              "  2003,\n",
              "  2024,\n",
              "  2049,\n",
              "  2083,\n",
              "  2094,\n",
              "  2173,\n",
              "  2239,\n",
              "  2278,\n",
              "  2290,\n",
              "  2306,\n",
              "  2331,\n",
              "  2415,\n",
              "  2427,\n",
              "  2523,\n",
              "  2537,\n",
              "  2550,\n",
              "  2565,\n",
              "  2566,\n",
              "  2597,\n",
              "  2644,\n",
              "  2754,\n",
              "  2757,\n",
              "  2832,\n",
              "  2974,\n",
              "  3030,\n",
              "  3081,\n",
              "  3102,\n",
              "  3252,\n",
              "  3269,\n",
              "  3274,\n",
              "  3280,\n",
              "  3370,\n",
              "  3392,\n",
              "  3399,\n",
              "  3508,\n",
              "  3526,\n",
              "  3571,\n",
              "  3581,\n",
              "  3628,\n",
              "  3727,\n",
              "  3740,\n",
              "  3817,\n",
              "  3965,\n",
              "  3968,\n",
              "  4264,\n",
              "  4295,\n",
              "  4372,\n",
              "  4442,\n",
              "  4456,\n",
              "  4574,\n",
              "  4649,\n",
              "  4717,\n",
              "  4730,\n",
              "  4758,\n",
              "  4775,\n",
              "  4870,\n",
              "  4962,\n",
              "  4963,\n",
              "  5080,\n",
              "  5104,\n",
              "  5258,\n",
              "  5397,\n",
              "  5701,\n",
              "  5708,\n",
              "  5920,\n",
              "  5996,\n",
              "  6198,\n",
              "  6210,\n",
              "  6215,\n",
              "  6310,\n",
              "  6418,\n",
              "  6470,\n",
              "  6531,\n",
              "  6546,\n",
              "  6580,\n",
              "  6897,\n",
              "  7053,\n",
              "  7337,\n",
              "  7366,\n",
              "  7403,\n",
              "  7473,\n",
              "  7609,\n",
              "  7691,\n",
              "  7775,\n",
              "  7816,\n",
              "  8475,\n",
              "  8676,\n",
              "  8715,\n",
              "  8761,\n",
              "  8765,\n",
              "  8872,\n",
              "  8979,\n",
              "  9007,\n",
              "  9232,\n",
              "  9448,\n",
              "  9607,\n",
              "  9706,\n",
              "  9890,\n",
              "  9895,\n",
              "  9915,\n",
              "  10012,\n",
              "  10088,\n",
              "  10244,\n",
              "  10267,\n",
              "  10327,\n",
              "  10507,\n",
              "  10708,\n",
              "  10738,\n",
              "  11503,\n",
              "  11568,\n",
              "  11704,\n",
              "  11767,\n",
              "  11798,\n",
              "  11829,\n",
              "  11934,\n",
              "  12222,\n",
              "  12436,\n",
              "  12562,\n",
              "  12610,\n",
              "  12650,\n",
              "  12677,\n",
              "  12810,\n",
              "  12818,\n",
              "  12922,\n",
              "  13656,\n",
              "  13685,\n",
              "  13938,\n",
              "  14211,\n",
              "  14446,\n",
              "  14774,\n",
              "  15176,\n",
              "  15436,\n",
              "  15923,\n",
              "  16098,\n",
              "  16221,\n",
              "  16341,\n",
              "  16355,\n",
              "  16622,\n",
              "  16984,\n",
              "  17175,\n",
              "  17324,\n",
              "  17779,\n",
              "  18133,\n",
              "  18150,\n",
              "  18323,\n",
              "  18419,\n",
              "  18606,\n",
              "  19797,\n",
              "  20051,\n",
              "  20134,\n",
              "  20437,\n",
              "  20464,\n",
              "  20863,\n",
              "  21163,\n",
              "  21618,\n",
              "  22498,\n",
              "  22851,\n",
              "  24054,\n",
              "  24117,\n",
              "  25950,\n",
              "  26835,\n",
              "  27019,\n",
              "  27382,\n",
              "  27806,\n",
              "  28817,\n",
              "  29111,\n",
              "  29215,\n",
              "  29278],\n",
              " 'values': [0.6244332790374756,\n",
              "  0.4568560719490051,\n",
              "  0.3084607720375061,\n",
              "  0.15860503911972046,\n",
              "  0.07250232994556427,\n",
              "  0.6492279767990112,\n",
              "  0.940220832824707,\n",
              "  0.31560876965522766,\n",
              "  0.7592713832855225,\n",
              "  1.9503644704818726,\n",
              "  0.3241194784641266,\n",
              "  0.3949938118457794,\n",
              "  0.23633737862110138,\n",
              "  0.2470736801624298,\n",
              "  0.42544642090797424,\n",
              "  1.960864782333374,\n",
              "  0.6286086440086365,\n",
              "  0.42353010177612305,\n",
              "  0.018384648486971855,\n",
              "  0.1946154683828354,\n",
              "  0.6674286723136902,\n",
              "  0.8161250352859497,\n",
              "  1.0953518152236938,\n",
              "  0.19782574474811554,\n",
              "  0.22626367211341858,\n",
              "  0.013579257763922215,\n",
              "  0.9045027494430542,\n",
              "  0.603290855884552,\n",
              "  0.6096806526184082,\n",
              "  0.03925827145576477,\n",
              "  0.129004567861557,\n",
              "  0.02316705882549286,\n",
              "  0.39762192964553833,\n",
              "  1.2140778303146362,\n",
              "  0.7067264318466187,\n",
              "  1.5109978914260864,\n",
              "  0.5313173532485962,\n",
              "  0.49864232540130615,\n",
              "  0.4654768109321594,\n",
              "  0.07612881064414978,\n",
              "  1.6882779598236084,\n",
              "  0.25088030099868774,\n",
              "  0.0354953333735466,\n",
              "  0.3241194784641266,\n",
              "  1.3433949947357178,\n",
              "  0.3027053773403168,\n",
              "  0.015504186972975731,\n",
              "  0.6244332790374756,\n",
              "  0.015504186972975731,\n",
              "  1.156782865524292,\n",
              "  0.4425300657749176,\n",
              "  0.42161011695861816,\n",
              "  1.3139126300811768,\n",
              "  0.052318159490823746,\n",
              "  0.4126010537147522,\n",
              "  0.0038986403960734606,\n",
              "  0.5427330136299133,\n",
              "  0.45499902963638306,\n",
              "  0.9162907600402832,\n",
              "  0.2160874605178833,\n",
              "  0.11343330889940262,\n",
              "  0.347847044467926,\n",
              "  0.3005385100841522,\n",
              "  0.09495500475168228,\n",
              "  0.12642613053321838,\n",
              "  0.8989537954330444,\n",
              "  0.39762192964553833,\n",
              "  0.11778303235769272,\n",
              "  0.0029254043474793434,\n",
              "  0.08782484382390976,\n",
              "  0.30558720231056213,\n",
              "  0.9944084882736206,\n",
              "  0.34577593207359314,\n",
              "  0.3554046154022217,\n",
              "  0.9256220459938049,\n",
              "  0.15359249711036682,\n",
              "  0.06246116757392883,\n",
              "  0.0842406153678894,\n",
              "  0.3526630103588104,\n",
              "  0.08513788133859634,\n",
              "  0.18978065252304077,\n",
              "  1.1524739265441895,\n",
              "  0.4512746334075928,\n",
              "  0.47402387857437134,\n",
              "  0.026025565341114998,\n",
              "  3.016606569290161,\n",
              "  0.19622190296649933,\n",
              "  0.15442965924739838,\n",
              "  0.38041436672210693,\n",
              "  1.0271050930023193,\n",
              "  0.5080875158309937,\n",
              "  0.4770587682723999,\n",
              "  0.24325250089168549,\n",
              "  0.8682814836502075,\n",
              "  0.1212492436170578,\n",
              "  0.14518201351165771,\n",
              "  0.14095009863376617,\n",
              "  0.029824240133166313,\n",
              "  0.10026945173740387,\n",
              "  0.21922965347766876,\n",
              "  1.0229004621505737,\n",
              "  1.1356772184371948,\n",
              "  1.4542449712753296,\n",
              "  0.14264501631259918,\n",
              "  0.00875066313892603,\n",
              "  0.5162794589996338,\n",
              "  0.27786844968795776,\n",
              "  0.1332872211933136,\n",
              "  0.022212404757738113,\n",
              "  0.015504186972975731,\n",
              "  0.5398913025856018,\n",
              "  0.7009293437004089,\n",
              "  0.14095009863376617,\n",
              "  0.16110190749168396,\n",
              "  0.04207121208310127,\n",
              "  0.03360854089260101,\n",
              "  0.997294545173645,\n",
              "  0.3177432417869568,\n",
              "  0.1221139207482338,\n",
              "  2.2553951740264893,\n",
              "  1.530631422996521,\n",
              "  0.4374985992908478,\n",
              "  0.3519764244556427,\n",
              "  0.13157635927200317,\n",
              "  0.29473719000816345,\n",
              "  0.029824240133166313,\n",
              "  0.13071982562541962,\n",
              "  0.5080875158309937,\n",
              "  2.953444480895996,\n",
              "  0.20660123229026794,\n",
              "  0.18654440343379974,\n",
              "  0.007782140281051397,\n",
              "  0.1905880719423294,\n",
              "  0.29255300760269165,\n",
              "  0.24554696679115295,\n",
              "  0.10731173306703568,\n",
              "  0.5255602598190308,\n",
              "  1.1141164302825928,\n",
              "  0.28597161173820496,\n",
              "  0.22704219818115234,\n",
              "  0.012615402229130268,\n",
              "  1.495358943939209,\n",
              "  0.46302130818367004,\n",
              "  2.35657000541687,\n",
              "  1.4597045183181763,\n",
              "  0.083342544734478,\n",
              "  1.8091849088668823,\n",
              "  0.35813871026039124,\n",
              "  1.5564985275268555,\n",
              "  1.3843393325805664,\n",
              "  0.34577593207359314,\n",
              "  0.5936289429664612,\n",
              "  0.34023189544677734,\n",
              "  0.8143964409828186,\n",
              "  1.3144375085830688,\n",
              "  0.2026219218969345,\n",
              "  0.7408206462860107,\n",
              "  0.34577593207359314,\n",
              "  0.03360854089260101,\n",
              "  0.10026945173740387,\n",
              "  0.6921701431274414,\n",
              "  0.07431721687316895,\n",
              "  0.12986256182193756,\n",
              "  0.25995752215385437,\n",
              "  0.01934296265244484,\n",
              "  0.5057345628738403,\n",
              "  0.33675122261047363,\n",
              "  1.603168249130249,\n",
              "  1.6402095556259155,\n",
              "  1.3862943649291992,\n",
              "  1.4487555027008057,\n",
              "  0.3601844012737274,\n",
              "  2.2772672176361084]}"
            ]
          },
          "execution_count": 16,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "values = sparse_emb[indices].cpu().tolist()\n",
        "sparse = {'indices': indices, 'values': values}\n",
        "sparse"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "PxMwAuqZMWEZ"
      },
      "source": [
        "This is the format that Pinecone requires, from here we can move on to indexing. We'll take a brief detour to explore the sparse vectors, but if you'd rather jump straight to indexing, skip the next section.\n",
        "\n",
        "---\n",
        "\n",
        "#### Reading Sparse Embedding\n",
        "\n",
        "But moving onto indexing everything in Pinecone, let's take a moment to understand what our sparse vector means. We can translate these into a human readable format so we can see what this sparse vector is actually representing.\n",
        "\n",
        "We create a way of mapping from index positions to actual BERT tokenizer tokens."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 17,
      "metadata": {
        "id": "iggT8ZVbMWEZ"
      },
      "outputs": [],
      "source": [
        "idx2token = {idx: token for token, idx in tokenizer.get_vocab().items()}"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "_TPFCgocMWEZ"
      },
      "source": [
        "Then create the mappings like we did with the Pinecone-friendly sparse format above."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 18,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "CiG7msWfMWEa",
        "outputId": "a27eacb4-f200-4f22-9f63-7e8ce3527810"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "{'pc': 3.02,\n",
              " 'lace': 2.95,\n",
              " 'programmed': 2.36,\n",
              " '##for': 2.28,\n",
              " 'madagascar': 2.26,\n",
              " 'death': 1.96,\n",
              " '##d': 1.95,\n",
              " 'lattice': 1.81,\n",
              " 'cell': 1.69,\n",
              " '##iensis': 1.64,\n",
              " 'malaga': 1.6,\n",
              " '##get': 1.56,\n",
              " 'regulated': 1.53,\n",
              " 'die': 1.51,\n",
              " 'lacey': 1.5,\n",
              " '##ono': 1.46,\n",
              " '##ole': 1.45,\n",
              " '##oles': 1.45,\n",
              " '##scu': 1.39,\n",
              " 'transverse': 1.38,\n",
              " 'leaves': 1.34,\n",
              " 'cells': 1.31,\n",
              " 'longitudinal': 1.31,\n",
              " 'plant': 1.21,\n",
              " 'plants': 1.16,\n",
              " 'leaf': 1.15,\n",
              " 'ap': 1.14,\n",
              " 'organism': 1.11,\n",
              " 'per': 1.1,\n",
              " 'regulation': 1.03,\n",
              " 'veins': 1.02,\n",
              " 'organisms': 1.0,\n",
              " '##work': 0.99,\n",
              " 'are': 0.94,\n",
              " 'modified': 0.93,\n",
              " 'controlled': 0.92,\n",
              " 'dead': 0.9,\n",
              " 'occur': 0.9,\n",
              " 'disorder': 0.87,\n",
              " 'program': 0.82,\n",
              " '##lat': 0.81,\n",
              " 'through': 0.76,\n",
              " '##cl': 0.74,\n",
              " 'computer': 0.71,\n",
              " '##ations': 0.7,\n",
              " 'abbreviation': 0.69,\n",
              " 'produced': 0.67,\n",
              " 'is': 0.65,\n",
              " 'center': 0.63,\n",
              " '\"': 0.62,\n",
              " 'produce': 0.62,\n",
              " 'technology': 0.61,\n",
              " 'process': 0.6,\n",
              " '##osing': 0.59,\n",
              " 'matt': 0.54,\n",
              " 'cc': 0.54,\n",
              " '##ation': 0.53,\n",
              " 'outward': 0.53,\n",
              " 'gage': 0.52,\n",
              " 'preston': 0.51,\n",
              " 'vein': 0.51,\n",
              " 'pathogen': 0.51,\n",
              " 'tree': 0.5,\n",
              " 'consist': 0.48,\n",
              " 'theory': 0.47,\n",
              " 'biology': 0.47,\n",
              " 'c': 0.46,\n",
              " 'fungus': 0.46,\n",
              " 'programming': 0.45,\n",
              " 'mechanism': 0.45,\n",
              " 'disease': 0.44,\n",
              " 'va': 0.44,\n",
              " 'within': 0.43,\n",
              " 'species': 0.42,\n",
              " 'en': 0.42,\n",
              " 'chamber': 0.41,\n",
              " 'structure': 0.4,\n",
              " '##ure': 0.4,\n",
              " '##on': 0.39,\n",
              " 'restricted': 0.38,\n",
              " 'destruction': 0.36,\n",
              " 'cp': 0.36,\n",
              " 'lc': 0.36,\n",
              " 'gene': 0.35,\n",
              " 'definition': 0.35,\n",
              " 'flower': 0.35,\n",
              " 'cellular': 0.35,\n",
              " 'defects': 0.35,\n",
              " 'fern': 0.35,\n",
              " '##cd': 0.34,\n",
              " 'pcs': 0.34,\n",
              " 'its': 0.32,\n",
              " 'place': 0.32,\n",
              " 'trees': 0.32,\n",
              " 'zombie': 0.32,\n",
              " 'p': 0.31,\n",
              " 'dying': 0.31,\n",
              " 'planned': 0.3,\n",
              " 'anger': 0.3,\n",
              " '##osis': 0.29,\n",
              " 'extinction': 0.29,\n",
              " '##aga': 0.29,\n",
              " 'flora': 0.28,\n",
              " '##lusion': 0.26,\n",
              " '##g': 0.25,\n",
              " 'fear': 0.25,\n",
              " '##elle': 0.25,\n",
              " '##c': 0.24,\n",
              " 'syndrome': 0.24,\n",
              " 'stop': 0.23,\n",
              " 'mutation': 0.23,\n",
              " 'ian': 0.22,\n",
              " 'gavin': 0.22,\n",
              " 'tumor': 0.21,\n",
              " 'position': 0.2,\n",
              " 'manufactured': 0.2,\n",
              " 'mesh': 0.2,\n",
              " 'production': 0.19,\n",
              " 'biological': 0.19,\n",
              " 'engineered': 0.19,\n",
              " 'insect': 0.19,\n",
              " 'of': 0.16,\n",
              " 'cam': 0.16,\n",
              " 'restoration': 0.15,\n",
              " 'survival': 0.15,\n",
              " 'cop': 0.15,\n",
              " 'proceeded': 0.14,\n",
              " 'heath': 0.14,\n",
              " 'regulatory': 0.14,\n",
              " 'via': 0.13,\n",
              " '##ds': 0.13,\n",
              " '##ode': 0.13,\n",
              " 'buzz': 0.13,\n",
              " 'herb': 0.13,\n",
              " 'inhibitor': 0.13,\n",
              " 'colony': 0.12,\n",
              " 'crops': 0.12,\n",
              " 'bug': 0.12,\n",
              " 'flowers': 0.11,\n",
              " 'regulate': 0.11,\n",
              " '##ose': 0.1,\n",
              " 'regulator': 0.1,\n",
              " 'device': 0.09,\n",
              " 'suicide': 0.09,\n",
              " 'fate': 0.09,\n",
              " '##tion': 0.08,\n",
              " 'penalty': 0.08,\n",
              " 'cb': 0.08,\n",
              " 'in': 0.07,\n",
              " 'pd': 0.07,\n",
              " 'vessels': 0.06,\n",
              " 'cancer': 0.05,\n",
              " 'stopped': 0.04,\n",
              " 'frank': 0.04,\n",
              " 'atlas': 0.04,\n",
              " 'genetic': 0.03,\n",
              " 'enzyme': 0.03,\n",
              " 'toxic': 0.03,\n",
              " 'doom': 0.03,\n",
              " '##tour': 0.03,\n",
              " 'association': 0.02,\n",
              " 'kill': 0.02,\n",
              " 'daniel': 0.02,\n",
              " 'ed': 0.02,\n",
              " 'eden': 0.02,\n",
              " 'bacteria': 0.02,\n",
              " '##tosis': 0.02,\n",
              " 'stage': 0.01,\n",
              " 'cia': 0.01,\n",
              " 'gm': 0.01,\n",
              " 'suppression': 0.01,\n",
              " 'les': 0.0,\n",
              " 'carter': 0.0}"
            ]
          },
          "execution_count": 18,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "sparse_dict_tokens = {\n",
        "    idx2token[idx]: round(weight, 2) for idx, weight in zip(indices, values)\n",
        "}\n",
        "# sort so we can see most relevant tokens first\n",
        "sparse_dict_tokens = {\n",
        "    k: v for k, v in sorted(\n",
        "        sparse_dict_tokens.items(),\n",
        "        key=lambda item: item[1],\n",
        "        reverse=True\n",
        "    )\n",
        "}\n",
        "sparse_dict_tokens"
      ]
    },
    {
      "attachments": {},
      "cell_type": "markdown",
      "metadata": {
        "id": "KxQuX6BaMWEa"
      },
      "source": [
        "---\n",
        "\n",
        "## Indexing Everything\n",
        "\n",
        "To build the vector DB we will need to index everything, for this we will need to initialize our connection to Pinecone, create an index, and insert everything in the format:\n",
        "\n",
        "```python\n",
        "{\n",
        "    'id': 'id-123',\n",
        "    'values': [0.1, 0.2, ...],  # dense vec\n",
        "    'sparse_values': {\n",
        "        'indices': [23, 718],\n",
        "        'values': [0.25, 0.77]\n",
        "    },  # sparse vec\n",
        "    'metadata': {\"context\": \"some text here\"}  # metadata dict\n",
        "}\n",
        "```\n",
        "\n",
        "To make things easier we can create a helper function to transform a list of records from `data` into this format, we'll call it `builder`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 19,
      "metadata": {
        "id": "OxPVelmIMWEa"
      },
      "outputs": [],
      "source": [
        "from pinecone import Pinecone\n",
        "\n",
        "\n",
        "def builder(records: list):\n",
        "    ids = [x['id'] for x in records]\n",
        "    contexts = [x['context'] for x in records]\n",
        "    # create dense vecs\n",
        "    dense_vecs = dense_model.encode(contexts).tolist()\n",
        "    # create sparse vecs\n",
        "    input_ids = tokenizer(\n",
        "        contexts, return_tensors='pt',\n",
        "        padding=True, truncation=True\n",
        "    )\n",
        "    with torch.no_grad():\n",
        "        sparse_vecs = sparse_model(\n",
        "            d_kwargs=input_ids.to(device)\n",
        "        )['d_rep'].squeeze()\n",
        "    # convert to upsert format\n",
        "    upserts = []\n",
        "    for _id, dense_vec, sparse_vec, context in zip(ids, dense_vecs, sparse_vecs, contexts):\n",
        "        # extract columns where there are non-zero weights\n",
        "        indices = sparse_vec.nonzero().squeeze().cpu().tolist()  # positions\n",
        "        values = sparse_vec[indices].cpu().tolist()  # weights/scores\n",
        "        # build sparse values dictionary\n",
        "        sparse_values = {\n",
        "            \"indices\": indices,\n",
        "            \"values\": values\n",
        "        }\n",
        "        # build metadata struct\n",
        "        metadata = {'context': context}\n",
        "        # append all to upserts list as pinecone.Vector (or GRPCVector)\n",
        "        upserts.append({\n",
        "            'id': _id,\n",
        "            'values': dense_vec,\n",
        "            'sparse_values': sparse_values,\n",
        "            'metadata': metadata\n",
        "        })\n",
        "    return upserts"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 20,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "8yIvXt_VMWEa",
        "outputId": "63cf140a-9627-4b4e-9e1c-cfc0e50e7c1b"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "[id: \"21645374-0\"\n",
              " values: -0.0860980972647667\n",
              " values: -0.06404605507850647\n",
              " values: -0.09067439287900925\n",
              " values: -0.13883446156978607\n",
              " values: 0.40349075198173523\n",
              " values: 0.04510989040136337\n",
              " values: 0.17842265963554382\n",
              " values: 0.008637930266559124\n",
              " values: 0.39867380261421204\n",
              " values: -0.12001233547925949\n",
              " values: -0.055883314460515976\n",
              " values: 0.1040591150522232\n",
              " values: -0.5984246730804443\n",
              " values: 0.4460744261741638\n",
              " values: 0.07607370615005493\n",
              " values: 0.718574583530426\n",
              " values: 0.13898858428001404\n",
              " values: -0.03241853415966034\n",
              " values: 0.05966181308031082\n",
              " values: 0.05813855305314064\n",
              " values: -0.14696815609931946\n",
              " values: 0.02058224566280842\n",
              " values: 0.7175166606903076\n",
              " values: 0.26266899704933167\n",
              " values: 0.18689090013504028\n",
              " values: -0.27962222695350647\n",
              " values: -0.4334171712398529\n",
              " values: -0.36501309275627136\n",
              " values: -0.4082491993904114\n",
              " values: 0.4922325313091278\n",
              " values: -0.04993252828717232\n",
              " values: -0.3248228430747986\n",
              " values: 0.14582324028015137\n",
              " values: -0.21379928290843964\n",
              " values: 0.06254779547452927\n",
              " values: -0.031296759843826294\n",
              " values: -0.5419846177101135\n",
              " values: -0.1686738133430481\n",
              " values: -0.44803133606910706\n",
              " values: -0.07544197887182236\n",
              " values: -0.36928415298461914\n",
              " values: -0.3000642955303192\n",
              " values: -0.32206887006759644\n",
              " values: 0.2181350588798523\n",
              " values: -0.04651939123868942\n",
              " values: 0.2682180404663086\n",
              " values: -1.3338631391525269\n",
              " values: 0.5395634174346924\n",
              " values: -0.18384556472301483\n",
              " values: -0.39647188782691956\n",
              " values: -0.7360967397689819\n",
              " values: 0.4210314452648163\n",
              " values: 0.4755152463912964\n",
              " values: 0.3136313259601593\n",
              " values: 0.4601867198944092\n",
              " values: 0.26082849502563477\n",
              " values: -0.2787572741508484\n",
              " values: 0.13298547267913818\n",
              " values: -0.15180712938308716\n",
              " values: -0.42153099179267883\n",
              " values: 0.260118305683136\n",
              " values: 0.10004347562789917\n",
              " values: -0.04248151183128357\n",
              " values: 0.26452821493148804\n",
              " values: 0.06057066470384598\n",
              " values: 0.27967721223831177\n",
              " values: 0.4233960211277008\n",
              " values: 0.29135310649871826\n",
              " values: -0.5620575547218323\n",
              " values: -0.005879288073629141\n",
              " values: -0.3624648153781891\n",
              " values: -0.14363759756088257\n",
              " values: 0.31823936104774475\n",
              " values: 0.08798645436763763\n",
              " values: -0.24319642782211304\n",
              " values: -0.6496345400810242\n",
              " values: -0.6208752393722534\n",
              " values: -0.022752122953534126\n",
              " values: 0.6055564284324646\n",
              " values: -0.010596863925457\n",
              " values: 0.23538754880428314\n",
              " values: 0.1528393030166626\n",
              " values: -0.16943034529685974\n",
              " values: 0.6552066206932068\n",
              " values: 0.0340227447450161\n",
              " values: -0.5892636775970459\n",
              " values: 0.3894413411617279\n",
              " values: 0.07519128918647766\n",
              " values: -0.2799113094806671\n",
              " values: 0.5042116641998291\n",
              " values: -0.4128768742084503\n",
              " values: 0.15226605534553528\n",
              " values: 0.10065246373414993\n",
              " values: 0.365783154964447\n",
              " values: -0.039370372891426086\n",
              " values: -0.26983705163002014\n",
              " values: 0.09370292723178864\n",
              " values: -0.023779748007655144\n",
              " values: 0.04133184999227524\n",
              " values: 0.08036313951015472\n",
              " values: -0.5440914630889893\n",
              " values: -0.2454611361026764\n",
              " values: -0.1826532781124115\n",
              " values: 0.19472528994083405\n",
              " values: -0.6277531385421753\n",
              " values: 0.06971830129623413\n",
              " values: 0.004776838235557079\n",
              " values: 0.03648645430803299\n",
              " values: -0.11422775685787201\n",
              " values: -0.1593732237815857\n",
              " values: -0.015335630625486374\n",
              " values: 0.262925386428833\n",
              " values: -0.1519542783498764\n",
              " values: -0.32560479640960693\n",
              " values: -0.07420266419649124\n",
              " values: 0.6682848334312439\n",
              " values: 0.2600383460521698\n",
              " values: -0.07099667191505432\n",
              " values: 0.00910197664052248\n",
              " values: -0.2406325340270996\n",
              " values: 0.02059176377952099\n",
              " values: 0.7395027875900269\n",
              " values: -0.323539137840271\n",
              " values: -0.018862204626202583\n",
              " values: 0.07888996601104736\n",
              " values: 0.15646393597126007\n",
              " values: 0.03952580690383911\n",
              " values: 0.06665738672018051\n",
              " values: -0.0728599950671196\n",
              " values: -0.22929885983467102\n",
              " values: 0.29133427143096924\n",
              " values: 0.08940722048282623\n",
              " values: -0.03731495141983032\n",
              " values: -0.1437409222126007\n",
              " values: 0.034087371081113815\n",
              " values: 0.0024752747267484665\n",
              " values: 0.3498768210411072\n",
              " values: -0.030251722782850266\n",
              " values: 0.37068971991539\n",
              " values: -0.04022026062011719\n",
              " values: -0.34226110577583313\n",
              " values: -0.536481499671936\n",
              " values: -0.135935977101326\n",
              " values: 0.4335070550441742\n",
              " values: 0.41264355182647705\n",
              " values: -0.30125007033348083\n",
              " values: -0.2287520468235016\n",
              " values: -0.4730832576751709\n",
              " values: 0.112075075507164\n",
              " values: -0.020654508844017982\n",
              " values: -0.2119382917881012\n",
              " values: 0.2227056324481964\n",
              " values: -0.16174399852752686\n",
              " values: -0.6142683625221252\n",
              " values: -0.3831552267074585\n",
              " values: 0.5320997834205627\n",
              " values: 0.8168519139289856\n",
              " values: -0.3035773038864136\n",
              " values: 0.019777944311499596\n",
              " values: -0.2673897445201874\n",
              " values: 0.11414450407028198\n",
              " values: 0.0015211544232442975\n",
              " values: -0.03230128437280655\n",
              " values: 0.13145700097084045\n",
              " values: 0.39681243896484375\n",
              " values: 0.038490504026412964\n",
              " values: 0.11624439805746078\n",
              " values: 0.21817272901535034\n",
              " values: -0.01752253621816635\n",
              " values: -0.3618130087852478\n",
              " values: -0.43851882219314575\n",
              " values: 0.3361433446407318\n",
              " values: 0.712823748588562\n",
              " values: -0.08677186071872711\n",
              " values: -0.455390602350235\n",
              " values: 0.17182520031929016\n",
              " values: 0.7055230736732483\n",
              " values: -0.39799821376800537\n",
              " values: 0.17404665052890778\n",
              " values: -0.1886599212884903\n",
              " values: -1.0115958452224731\n",
              " values: 0.46696707606315613\n",
              " values: -0.25263091921806335\n",
              " values: 0.6079217791557312\n",
              " values: -0.32424917817115784\n",
              " values: -0.18209756910800934\n",
              " values: 0.4254169762134552\n",
              " values: -0.2962520718574524\n",
              " values: 0.1739547997713089\n",
              " values: 0.24175222218036652\n",
              " values: -0.2527625262737274\n",
              " values: -0.17476916313171387\n",
              " values: 0.3306097090244293\n",
              " values: -0.22536936402320862\n",
              " values: 0.4896939992904663\n",
              " values: -0.36988407373428345\n",
              " values: 0.019705433398485184\n",
              " values: 0.27753859758377075\n",
              " values: 0.30619171261787415\n",
              " values: 0.5737355947494507\n",
              " values: -0.592156171798706\n",
              " values: 0.12541282176971436\n",
              " values: 0.19397461414337158\n",
              " values: -0.21707668900489807\n",
              " values: -0.430096298456192\n",
              " values: 0.7432089447975159\n",
              " values: -0.06907758861780167\n",
              " values: -0.1660095602273941\n",
              " values: 0.618442952632904\n",
              " values: 0.1381261646747589\n",
              " values: -0.12770576775074005\n",
              " values: -0.40965649485588074\n",
              " values: 0.38166582584381104\n",
              " values: 0.06050394847989082\n",
              " values: 0.4137199819087982\n",
              " values: -0.30666279792785645\n",
              " values: 0.16314852237701416\n",
              " values: -0.2640727460384369\n",
              " values: 0.11122335493564606\n",
              " values: -0.6496098637580872\n",
              " values: -0.28033480048179626\n",
              " values: 0.26266175508499146\n",
              " values: 0.23728159070014954\n",
              " values: 0.4385393559932709\n",
              " values: 0.09267628937959671\n",
              " values: 1.0801664590835571\n",
              " values: 0.4716159701347351\n",
              " values: -0.6543506383895874\n",
              " values: 0.10799122601747513\n",
              " values: -0.24221265316009521\n",
              " values: -0.14696091413497925\n",
              " values: -0.14935576915740967\n",
              " values: 0.11266341805458069\n",
              " values: -0.15048804879188538\n",
              " values: 0.0897727981209755\n",
              " values: 0.4505968689918518\n",
              " values: -0.28451910614967346\n",
              " values: -0.29204076528549194\n",
              " values: 0.1936362385749817\n",
              " values: -0.508689284324646\n",
              " values: 0.27896901965141296\n",
              " values: 0.17268870770931244\n",
              " values: 0.0038560747634619474\n",
              " values: 0.0796423852443695\n",
              " values: 0.15739527344703674\n",
              " values: 0.13494664430618286\n",
              " values: 0.30528882145881653\n",
              " values: 0.11713887006044388\n",
              " values: -0.411358505487442\n",
              " values: 0.05025112256407738\n",
              " values: -0.04907873272895813\n",
              " values: 0.11879558116197586\n",
              " values: 0.24762436747550964\n",
              " values: 0.0822138860821724\n",
              " values: 0.06377542018890381\n",
              " values: -0.008826708421111107\n",
              " values: -0.17943638563156128\n",
              " values: -0.2646384537220001\n",
              " values: 0.2298423796892166\n",
              " values: 0.015309852547943592\n",
              " values: -0.12190074473619461\n",
              " values: -0.018918469548225403\n",
              " values: 0.16498978435993195\n",
              " values: -0.0643836185336113\n",
              " values: -0.08843336999416351\n",
              " values: -0.30697983503341675\n",
              " values: -0.3627757728099823\n",
              " values: -0.42430806159973145\n",
              " values: 0.6752092838287354\n",
              " values: 0.12161140888929367\n",
              " values: 0.5717501044273376\n",
              " values: -0.027110561728477478\n",
              " values: -0.048856351524591446\n",
              " values: -0.3212795555591583\n",
              " values: -0.14272978901863098\n",
              " values: -0.2446998506784439\n",
              " values: 0.43910107016563416\n",
              " values: 0.4897882342338562\n",
              " values: -0.08657290786504745\n",
              " values: 0.3833068311214447\n",
              " values: 0.07841639220714569\n",
              " values: 0.1527005434036255\n",
              " values: 0.043815914541482925\n",
              " values: -0.1698896437883377\n",
              " values: 0.24944435060024261\n",
              " values: -0.141409769654274\n",
              " values: -0.05958908796310425\n",
              " values: -0.7791208028793335\n",
              " values: -0.29912039637565613\n",
              " values: -0.10057766735553741\n",
              " values: -0.15425443649291992\n",
              " values: 0.4143713712692261\n",
              " values: -0.22397030889987946\n",
              " values: 0.019624410197138786\n",
              " values: 0.15246856212615967\n",
              " values: -0.09493224322795868\n",
              " values: 0.14478614926338196\n",
              " values: 0.3380369544029236\n",
              " values: -0.05808714032173157\n",
              " values: 0.06054004281759262\n",
              " values: 0.2309354841709137\n",
              " values: 0.34729254245758057\n",
              " values: 0.05459621921181679\n",
              " values: 0.2815243899822235\n",
              " values: -0.28254789113998413\n",
              " values: 0.3764306902885437\n",
              " values: 0.30095547437667847\n",
              " values: -0.35638847947120667\n",
              " values: -10.816837310791016\n",
              " values: 0.24344445765018463\n",
              " values: 0.20749010145664215\n",
              " values: -0.38377830386161804\n",
              " values: 0.2743619978427887\n",
              " values: 0.4892863929271698\n",
              " values: 0.4105406403541565\n",
              " values: 0.2514961063861847\n",
              " values: -0.04200278967618942\n",
              " values: -0.026722600683569908\n",
              " values: -0.04073556512594223\n",
              " values: -0.34193524718284607\n",
              " values: 0.16124878823757172\n",
              " values: 0.056342095136642456\n",
              " values: 0.4114670753479004\n",
              " values: 0.08182182163000107\n",
              " values: -0.3648662269115448\n",
              " values: -0.5812361836433411\n",
              " values: -0.14538486301898956\n",
              " values: 0.08064592629671097\n",
              " values: -0.17144779860973358\n",
              " values: -0.29520151019096375\n",
              " values: -0.27009111642837524\n",
              " values: -0.1768135279417038\n",
              " values: -0.0415738970041275\n",
              " values: -0.45988062024116516\n",
              " values: -0.25476282835006714\n",
              " values: -0.22053909301757812\n",
              " values: -0.20645707845687866\n",
              " values: -0.2868165373802185\n",
              " values: -0.004217307548969984\n",
              " values: -0.2712891697883606\n",
              " values: 0.17324793338775635\n",
              " values: 0.08032267540693283\n",
              " values: 0.23174718022346497\n",
              " values: -0.25436121225357056\n",
              " values: 0.36838820576667786\n",
              " values: -0.19396832585334778\n",
              " values: -0.2416202425956726\n",
              " values: -0.09366412460803986\n",
              " values: -0.04590333625674248\n",
              " values: -0.40972498059272766\n",
              " values: -0.14870081841945648\n",
              " values: 0.2837999761104584\n",
              " values: 0.05115250125527382\n",
              " values: -0.0070237466134130955\n",
              " values: 0.1597277671098709\n",
              " values: 0.24587398767471313\n",
              " values: -0.18962576985359192\n",
              " values: 0.4761332869529724\n",
              " values: -0.1646009236574173\n",
              " values: 0.2908559739589691\n",
              " values: 0.7872990965843201\n",
              " values: 0.04559296742081642\n",
              " values: 0.22842122614383698\n",
              " values: -0.05601680651307106\n",
              " values: -0.010517125949263573\n",
              " values: 0.16431325674057007\n",
              " values: -0.4768017828464508\n",
              " values: -0.21407324075698853\n",
              " values: -0.022104425355792046\n",
              " values: -0.23495718836784363\n",
              " values: 0.06469808518886566\n",
              " values: -0.5093300938606262\n",
              " values: 0.206990584731102\n",
              " values: 0.17427316308021545\n",
              " values: -0.6567267179489136\n",
              " values: -0.11650726944208145\n",
              " values: 0.21576975286006927\n",
              " values: 0.3068740665912628\n",
              " values: -0.19138123095035553\n",
              " values: -0.005177704617381096\n",
              " values: -0.17973089218139648\n",
              " values: -2.4131124019622803\n",
              " values: -0.2590559124946594\n",
              " values: -0.3196983337402344\n",
              " values: 0.14314299821853638\n",
              " values: -0.4858211874961853\n",
              " values: 0.2061004638671875\n",
              " values: -0.140701025724411\n",
              " values: -0.0941932201385498\n",
              " values: 0.28994080424308777\n",
              " values: 0.3878782391548157\n",
              " values: 0.06944607943296432\n",
              " values: 0.2682979702949524\n",
              " values: -0.14871510863304138\n",
              " values: -0.35508203506469727\n",
              " values: 0.05125150457024574\n",
              " values: -0.06450026482343674\n",
              " values: 0.06608251482248306\n",
              " values: 0.3930386006832123\n",
              " values: -0.2764521539211273\n",
              " values: -0.5646374225616455\n",
              " values: -0.08041297644376755\n",
              " values: 0.005091561004519463\n",
              " values: 0.3662455081939697\n",
              " values: -0.13771465420722961\n",
              " values: 0.012935377657413483\n",
              " values: 0.31125807762145996\n",
              " values: -0.06795591861009598\n",
              " values: 0.2544695734977722\n",
              " values: -0.46574804186820984\n",
              " values: -0.013212955556809902\n",
              " values: 0.015142131596803665\n",
              " values: 0.1447831094264984\n",
              " values: -0.03621048852801323\n",
              " values: -0.3476147949695587\n",
              " values: 0.6222864389419556\n",
              " values: 0.24649706482887268\n",
              " values: -0.0061971708200871944\n",
              " values: 0.10787487775087357\n",
              " values: 0.1440703570842743\n",
              " values: 0.08756859600543976\n",
              " values: -0.576193630695343\n",
              " values: 0.6345756649971008\n",
              " values: 0.06679406017065048\n",
              " values: 0.5166506767272949\n",
              " values: 0.14890676736831665\n",
              " values: 0.3295409381389618\n",
              " values: -0.3473602831363678\n",
              " values: -0.5812732577323914\n",
              " values: 0.04666227474808693\n",
              " values: -0.08702550083398819\n",
              " values: 0.2158004641532898\n",
              " values: -0.3761124312877655\n",
              " values: 0.5065014958381653\n",
              " values: 0.1496351957321167\n",
              " values: -0.08677279949188232\n",
              " values: 0.08513689786195755\n",
              " values: -0.091736800968647\n",
              " values: -0.3347877264022827\n",
              " values: 0.06455213576555252\n",
              " values: -0.2537630796432495\n",
              " values: 0.043056946247816086\n",
              " values: 0.1873088926076889\n",
              " values: 0.0004078223428223282\n",
              " values: -0.15935805439949036\n",
              " values: -0.42408955097198486\n",
              " values: 0.021829817444086075\n",
              " values: -0.04314940795302391\n",
              " values: -0.2642165422439575\n",
              " values: -0.07996424287557602\n",
              " values: 0.08443905413150787\n",
              " values: -0.2918468415737152\n",
              " values: 0.5334410071372986\n",
              " values: 0.590804398059845\n",
              " values: 0.041985947638750076\n",
              " values: 0.011117925867438316\n",
              " values: 0.0016932317521423101\n",
              " values: 0.02835880033671856\n",
              " values: 0.19023343920707703\n",
              " values: -0.10392723232507706\n",
              " values: 0.428425669670105\n",
              " values: -0.1723605990409851\n",
              " values: -0.18274827301502228\n",
              " values: 0.27789512276649475\n",
              " values: 0.5998272895812988\n",
              " values: 0.01706884428858757\n",
              " values: 0.17428182065486908\n",
              " values: -0.5499603748321533\n",
              " values: 0.057738952338695526\n",
              " values: -0.028982723131775856\n",
              " values: -0.6492184400558472\n",
              " values: -0.2627772092819214\n",
              " values: -0.06587100028991699\n",
              " values: 0.45255225896835327\n",
              " values: 0.26146236062049866\n",
              " values: -0.4001302123069763\n",
              " values: -0.02260308526456356\n",
              " values: 0.00010707221372285858\n",
              " values: 0.04649481922388077\n",
              " values: 0.002225675852969289\n",
              " values: -0.1694978028535843\n",
              " values: 0.3439384400844574\n",
              " values: 0.12588657438755035\n",
              " values: 0.2515954077243805\n",
              " values: -0.0990796685218811\n",
              " values: -0.3080807328224182\n",
              " values: 0.26543065905570984\n",
              " values: 0.5367224216461182\n",
              " values: -0.24357575178146362\n",
              " values: -0.6224591732025146\n",
              " values: 0.10550893843173981\n",
              " values: 0.23066893219947815\n",
              " values: -0.054014693945646286\n",
              " values: 0.24460767209529877\n",
              " values: -0.11751005053520203\n",
              " values: -0.5013086199760437\n",
              " values: -0.23152893781661987\n",
              " values: 0.1501777470111847\n",
              " values: 0.22126466035842896\n",
              " values: 0.20040155947208405\n",
              " values: 0.060330428183078766\n",
              " values: -0.1593562215566635\n",
              " values: -0.1574459671974182\n",
              " values: -0.3058134913444519\n",
              " values: -0.21795138716697693\n",
              " values: 0.9226051568984985\n",
              " values: 0.2082580178976059\n",
              " values: -0.3193359375\n",
              " values: -0.17587822675704956\n",
              " values: -0.35362622141838074\n",
              " values: -0.14742401242256165\n",
              " values: 0.05250873789191246\n",
              " values: 0.5002002716064453\n",
              " values: -0.3984605669975281\n",
              " values: 0.451018750667572\n",
              " values: -0.32582810521125793\n",
              " values: -0.6055240631103516\n",
              " values: 0.16006700694561005\n",
              " values: -0.21099945902824402\n",
              " values: -0.2766692340373993\n",
              " values: 0.02156851254403591\n",
              " values: 0.2462395876646042\n",
              " values: 0.045449838042259216\n",
              " values: 0.16657525300979614\n",
              " values: 0.3626709282398224\n",
              " values: -0.1117924153804779\n",
              " values: -0.36229777336120605\n",
              " values: -0.21208514273166656\n",
              " values: 0.20183923840522766\n",
              " values: -0.11175581812858582\n",
              " values: 0.18034683167934418\n",
              " values: -0.4353330433368683\n",
              " values: -0.5567545890808105\n",
              " values: 0.23030424118041992\n",
              " values: -0.2744635343551636\n",
              " values: -0.47252553701400757\n",
              " values: 0.5733309984207153\n",
              " values: 0.27451837062835693\n",
              " values: -0.029854344204068184\n",
              " values: -0.13601770997047424\n",
              " values: -0.6022977232933044\n",
              " values: 0.47675642371177673\n",
              " values: -0.28841495513916016\n",
              " values: -0.3105325400829315\n",
              " values: -0.25184741616249084\n",
              " values: 0.4046817719936371\n",
              " values: -0.2756727933883667\n",
              " values: 0.004485787358134985\n",
              " values: 0.2713607847690582\n",
              " values: 0.6434268951416016\n",
              " values: 0.03192445635795593\n",
              " values: -0.08218193054199219\n",
              " values: 0.21579629182815552\n",
              " values: 0.4633536636829376\n",
              " values: -0.2292701154947281\n",
              " values: -0.06861899793148041\n",
              " values: 0.13546128571033478\n",
              " values: 0.4321329593658447\n",
              " values: -0.33609744906425476\n",
              " values: 0.02943151257932186\n",
              " values: 0.27100929617881775\n",
              " values: 0.13214728236198425\n",
              " values: 0.43676167726516724\n",
              " values: -0.4648359417915344\n",
              " values: 0.04408570006489754\n",
              " values: -0.18532314896583557\n",
              " values: -0.11615624278783798\n",
              " values: 0.182780459523201\n",
              " values: -0.23333895206451416\n",
              " values: 0.35903340578079224\n",
              " values: 0.07699722051620483\n",
              " values: 0.1724790781736374\n",
              " values: 0.11561737209558487\n",
              " values: 0.0765710324048996\n",
              " values: -0.14055798947811127\n",
              " values: -0.23227018117904663\n",
              " values: 0.5600752830505371\n",
              " values: 0.14043188095092773\n",
              " values: 0.6779339909553528\n",
              " values: 0.34005528688430786\n",
              " values: 0.12350992113351822\n",
              " values: 0.37375515699386597\n",
              " values: 0.2723630368709564\n",
              " values: 0.08521663397550583\n",
              " values: 0.023898640647530556\n",
              " values: 0.09348875284194946\n",
              " values: 0.36186766624450684\n",
              " values: -0.2480231076478958\n",
              " values: -0.11226063966751099\n",
              " values: 0.36514440178871155\n",
              " values: -0.36515146493911743\n",
              " values: -0.20479440689086914\n",
              " values: 0.1609896421432495\n",
              " values: -0.29332756996154785\n",
              " values: 0.2608568072319031\n",
              " values: -0.185627743601799\n",
              " values: -0.08300001174211502\n",
              " values: -0.538398265838623\n",
              " values: 0.33837637305259705\n",
              " values: 0.3566510081291199\n",
              " values: 0.1927640587091446\n",
              " values: -0.3572070300579071\n",
              " values: 0.18981778621673584\n",
              " values: 0.2758878469467163\n",
              " values: 0.5334838032722473\n",
              " values: 0.4541890025138855\n",
              " values: 0.4553162753582001\n",
              " values: 0.027097823098301888\n",
              " values: -0.6189607977867126\n",
              " values: 0.42711126804351807\n",
              " values: 0.36978137493133545\n",
              " values: -0.5436980128288269\n",
              " values: -0.36145102977752686\n",
              " values: 0.1341329663991928\n",
              " values: 0.2812073230743408\n",
              " values: -0.30277019739151\n",
              " values: -0.19557492434978485\n",
              " values: -0.08402638137340546\n",
              " values: 0.3332456648349762\n",
              " values: -0.4908011257648468\n",
              " values: 0.4548834562301636\n",
              " values: -0.3085594177246094\n",
              " values: -0.16658413410186768\n",
              " values: -0.3208610713481903\n",
              " values: 0.12168848514556885\n",
              " values: -0.39368346333503723\n",
              " values: 0.012268094345927238\n",
              " values: -0.42766982316970825\n",
              " values: 0.7013814449310303\n",
              " values: -0.22398166358470917\n",
              " values: 0.5469760298728943\n",
              " values: -0.20185627043247223\n",
              " values: 0.15621820092201233\n",
              " values: 0.19703054428100586\n",
              " values: -0.6165722608566284\n",
              " values: 0.201776921749115\n",
              " values: 0.1903771162033081\n",
              " values: 0.5414808392524719\n",
              " values: 0.7267144918441772\n",
              " values: 0.2956739068031311\n",
              " values: 0.31504496932029724\n",
              " values: 0.7925106287002563\n",
              " values: 0.01044751238077879\n",
              " values: 0.3757437467575073\n",
              " values: -0.3657616078853607\n",
              " values: -0.28786924481391907\n",
              " values: -0.24510343372821808\n",
              " values: -0.2222878634929657\n",
              " values: 0.3762718439102173\n",
              " values: 0.32096773386001587\n",
              " values: -0.18696296215057373\n",
              " values: 0.19617198407649994\n",
              " values: 0.7129471898078918\n",
              " values: 0.19962185621261597\n",
              " values: 0.332816481590271\n",
              " values: -0.24314995110034943\n",
              " values: -0.25521019101142883\n",
              " values: 0.3446792960166931\n",
              " values: 0.22582527995109558\n",
              " values: 0.06877933442592621\n",
              " values: 0.08953117579221725\n",
              " values: -0.3202141523361206\n",
              " values: 0.21105153858661652\n",
              " values: -0.2057797759771347\n",
              " values: 0.5475863218307495\n",
              " values: 0.00908522866666317\n",
              " values: -0.4061272442340851\n",
              " values: 0.24627216160297394\n",
              " values: -0.6629643440246582\n",
              " values: -0.2769065201282501\n",
              " values: 0.4549218416213989\n",
              " values: 0.24261201918125153\n",
              " values: -0.2633229196071625\n",
              " values: 0.022713465616106987\n",
              " values: 0.02063814364373684\n",
              " values: -0.109161376953125\n",
              " values: -0.1877521127462387\n",
              " values: 0.09999947249889374\n",
              " values: 0.3244074285030365\n",
              " values: -0.2863481640815735\n",
              " values: -0.4002719223499298\n",
              " values: 0.04375741630792618\n",
              " values: 0.0025314658414572477\n",
              " values: -0.31069788336753845\n",
              " values: -0.01686335727572441\n",
              " values: 0.0035823583602905273\n",
              " values: 0.3879871070384979\n",
              " values: 0.22839219868183136\n",
              " values: -0.2587563991546631\n",
              " values: -0.5878481864929199\n",
              " values: -0.28407716751098633\n",
              " values: -0.05879341438412666\n",
              " values: 0.04386133328080177\n",
              " values: -0.6633378267288208\n",
              " values: -0.07314661145210266\n",
              " values: 0.34976595640182495\n",
              " values: -0.3240869641304016\n",
              " values: 0.06405896693468094\n",
              " values: 0.10957256704568863\n",
              " values: -0.36990395188331604\n",
              " values: 0.048569560050964355\n",
              " values: -0.07968524843454361\n",
              " values: -0.091741181910038\n",
              " values: 0.09071293473243713\n",
              " values: 0.41267654299736023\n",
              " values: -0.07841753214597702\n",
              " values: 0.3452684283256531\n",
              " values: 0.04587786644697189\n",
              " values: -0.19919154047966003\n",
              " values: 0.3115084767341614\n",
              " values: -0.22291405498981476\n",
              " values: -0.012917399406433105\n",
              " values: -0.22638775408267975\n",
              " values: 0.6717984676361084\n",
              " values: -0.4587689936161041\n",
              " values: -0.01929898001253605\n",
              " values: -0.4923480451107025\n",
              " values: 0.29688122868537903\n",
              " values: 0.350331574678421\n",
              " values: -0.3423391580581665\n",
              " values: -0.3219289183616638\n",
              " values: 0.9413825869560242\n",
              " values: 0.04295717552304268\n",
              " values: 0.3324008285999298\n",
              " values: 0.037330642342567444\n",
              " values: -0.2420802265405655\n",
              " values: 0.08089488744735718\n",
              " values: -0.6425266265869141\n",
              " values: -0.28280845284461975\n",
              " values: -0.4313257932662964\n",
              " values: 0.31138330698013306\n",
              " values: 0.652033805847168\n",
              " values: -0.2607569098472595\n",
              " values: 0.6607511639595032\n",
              " values: 0.41731202602386475\n",
              " values: -0.05641606077551842\n",
              " values: -0.2541080117225647\n",
              " values: 0.4510383903980255\n",
              " values: -0.009591680020093918\n",
              " values: 0.2018149048089981\n",
              " values: -0.1502242088317871\n",
              " values: -0.21784353256225586\n",
              " values: 0.134852796792984\n",
              " values: -0.5799630284309387\n",
              " values: -0.07054205983877182\n",
              " values: 0.289808452129364\n",
              " values: -0.088861845433712\n",
              " values: -0.49308115243911743\n",
              " values: -0.3295972943305969\n",
              " values: -0.001585095771588385\n",
              " values: -0.11541340500116348\n",
              " values: -0.17935888469219208\n",
              " values: -0.08839793503284454\n",
              " values: -0.03305484354496002\n",
              " values: -0.1552291363477707\n",
              " values: -0.4620879590511322\n",
              " values: -0.19951169192790985\n",
              " values: -0.09290609508752823\n",
              " values: 0.06417856365442276\n",
              " values: -0.04185223951935768\n",
              " values: -0.024476999416947365\n",
              " values: 0.000799410801846534\n",
              " values: 0.08312862366437912\n",
              " values: 0.01748950406908989\n",
              " values: 0.07615586370229721\n",
              " values: 0.03427988663315773\n",
              " values: 0.3066460192203522\n",
              " values: 0.29970449209213257\n",
              " metadata {\n",
              "   fields {\n",
              "     key: \"context\"\n",
              "     value {\n",
              "       string_value: \"Programmed cell death (PCD) is the regulated death of cells within an organism. The lace plant (Aponogeton madagascariensis) produces perforations in its leaves through PCD. The leaves of the plant consist of a latticework of longitudinal and transverse veins enclosing areoles. PCD occurs in the cells at the center of these areoles and progresses outwards, stopping approximately five cells from the vasculature.\"\n",
              "     }\n",
              "   }\n",
              " }\n",
              " sparse_values {\n",
              "   indices: 1000\n",
              "   indices: 1039\n",
              "   indices: 1052\n",
              "   indices: 1997\n",
              "   indices: 1999\n",
              "   indices: 2003\n",
              "   indices: 2024\n",
              "   indices: 2049\n",
              "   indices: 2083\n",
              "   indices: 2094\n",
              "   indices: 2173\n",
              "   indices: 2239\n",
              "   indices: 2278\n",
              "   indices: 2290\n",
              "   indices: 2306\n",
              "   indices: 2331\n",
              "   indices: 2415\n",
              "   indices: 2427\n",
              "   indices: 2523\n",
              "   indices: 2537\n",
              "   indices: 2550\n",
              "   indices: 2565\n",
              "   indices: 2566\n",
              "   indices: 2597\n",
              "   indices: 2644\n",
              "   indices: 2754\n",
              "   indices: 2757\n",
              "   indices: 2832\n",
              "   indices: 2974\n",
              "   indices: 3030\n",
              "   indices: 3081\n",
              "   indices: 3102\n",
              "   indices: 3252\n",
              "   indices: 3269\n",
              "   indices: 3274\n",
              "   indices: 3280\n",
              "   indices: 3370\n",
              "   indices: 3392\n",
              "   indices: 3399\n",
              "   indices: 3508\n",
              "   indices: 3526\n",
              "   indices: 3571\n",
              "   indices: 3581\n",
              "   indices: 3628\n",
              "   indices: 3727\n",
              "   indices: 3740\n",
              "   indices: 3817\n",
              "   indices: 3965\n",
              "   indices: 3968\n",
              "   indices: 4264\n",
              "   indices: 4295\n",
              "   indices: 4372\n",
              "   indices: 4442\n",
              "   indices: 4456\n",
              "   indices: 4574\n",
              "   indices: 4649\n",
              "   indices: 4717\n",
              "   indices: 4730\n",
              "   indices: 4758\n",
              "   indices: 4775\n",
              "   indices: 4870\n",
              "   indices: 4962\n",
              "   indices: 4963\n",
              "   indices: 5080\n",
              "   indices: 5104\n",
              "   indices: 5258\n",
              "   indices: 5397\n",
              "   indices: 5701\n",
              "   indices: 5920\n",
              "   indices: 5996\n",
              "   indices: 6198\n",
              "   indices: 6210\n",
              "   indices: 6215\n",
              "   indices: 6310\n",
              "   indices: 6418\n",
              "   indices: 6470\n",
              "   indices: 6531\n",
              "   indices: 6546\n",
              "   indices: 6580\n",
              "   indices: 6897\n",
              "   indices: 7053\n",
              "   indices: 7337\n",
              "   indices: 7366\n",
              "   indices: 7403\n",
              "   indices: 7473\n",
              "   indices: 7609\n",
              "   indices: 7691\n",
              "   indices: 7775\n",
              "   indices: 7816\n",
              "   indices: 8475\n",
              "   indices: 8676\n",
              "   indices: 8715\n",
              "   indices: 8761\n",
              "   indices: 8765\n",
              "   indices: 8872\n",
              "   indices: 8979\n",
              "   indices: 9007\n",
              "   indices: 9232\n",
              "   indices: 9448\n",
              "   indices: 9607\n",
              "   indices: 9706\n",
              "   indices: 9890\n",
              "   indices: 9895\n",
              "   indices: 9915\n",
              "   indices: 10012\n",
              "   indices: 10088\n",
              "   indices: 10244\n",
              "   indices: 10267\n",
              "   indices: 10327\n",
              "   indices: 10507\n",
              "   indices: 10708\n",
              "   indices: 10738\n",
              "   indices: 11503\n",
              "   indices: 11568\n",
              "   indices: 11704\n",
              "   indices: 11767\n",
              "   indices: 11798\n",
              "   indices: 11829\n",
              "   indices: 11934\n",
              "   indices: 12222\n",
              "   indices: 12436\n",
              "   indices: 12562\n",
              "   indices: 12610\n",
              "   indices: 12650\n",
              "   indices: 12677\n",
              "   indices: 12810\n",
              "   indices: 12818\n",
              "   indices: 12922\n",
              "   indices: 13656\n",
              "   indices: 13685\n",
              "   indices: 13938\n",
              "   indices: 14211\n",
              "   indices: 14446\n",
              "   indices: 14774\n",
              "   indices: 15176\n",
              "   indices: 15436\n",
              "   indices: 15923\n",
              "   indices: 16098\n",
              "   indices: 16221\n",
              "   indices: 16341\n",
              "   indices: 16355\n",
              "   indices: 16622\n",
              "   indices: 16984\n",
              "   indices: 17175\n",
              "   indices: 17324\n",
              "   indices: 17779\n",
              "   indices: 18133\n",
              "   indices: 18150\n",
              "   indices: 18323\n",
              "   indices: 18419\n",
              "   indices: 18606\n",
              "   indices: 19723\n",
              "   indices: 19797\n",
              "   indices: 20051\n",
              "   indices: 20134\n",
              "   indices: 20437\n",
              "   indices: 20464\n",
              "   indices: 20863\n",
              "   indices: 21163\n",
              "   indices: 21618\n",
              "   indices: 22498\n",
              "   indices: 22851\n",
              "   indices: 24054\n",
              "   indices: 24117\n",
              "   indices: 25950\n",
              "   indices: 26835\n",
              "   indices: 27019\n",
              "   indices: 27382\n",
              "   indices: 27806\n",
              "   indices: 28817\n",
              "   indices: 29111\n",
              "   indices: 29215\n",
              "   indices: 29278\n",
              "   values: 0.6244332790374756\n",
              "   values: 0.45623743534088135\n",
              "   values: 0.3084607720375061\n",
              "   values: 0.15777134895324707\n",
              "   values: 0.07250232994556427\n",
              "   values: 0.6502478122711182\n",
              "   values: 0.940220832824707\n",
              "   values: 0.3170322775840759\n",
              "   values: 0.7592713832855225\n",
              "   values: 1.9498088359832764\n",
              "   values: 0.32341301441192627\n",
              "   values: 0.39367714524269104\n",
              "   values: 0.23556606471538544\n",
              "   values: 0.24631060659885406\n",
              "   values: 0.4248080551624298\n",
              "   values: 1.9603148698806763\n",
              "   values: 0.6296497583389282\n",
              "   values: 0.4248080551624298\n",
              "   values: 0.018384648486971855\n",
              "   values: 0.19622190296649933\n",
              "   values: 0.6689305305480957\n",
              "   values: 0.8161250352859497\n",
              "   values: 1.0953518152236938\n",
              "   values: 0.19862671196460724\n",
              "   values: 0.22626367211341858\n",
              "   values: 0.014542185701429844\n",
              "   values: 0.9037119746208191\n",
              "   values: 0.6022219061851501\n",
              "   values: 0.6102113127708435\n",
              "   values: 0.03831886500120163\n",
              "   values: 0.129004567861557\n",
              "   values: 0.02412080205976963\n",
              "   values: 0.39762192964553833\n",
              "   values: 1.2140778303146362\n",
              "   values: 0.7047978043556213\n",
              "   values: 1.5109978914260864\n",
              "   values: 0.5324648022651672\n",
              "   values: 0.49864232540130615\n",
              "   values: 0.4673144817352295\n",
              "   values: 0.0770333781838417\n",
              "   values: 1.6889997720718384\n",
              "   values: 0.25239890813827515\n",
              "   values: 0.0354953333735466\n",
              "   values: 0.3241194784641266\n",
              "   values: 1.3428852558135986\n",
              "   values: 0.30486753582954407\n",
              "   values: 0.014542185701429844\n",
              "   values: 0.6254787445068359\n",
              "   values: 0.014542185701429844\n",
              "   values: 1.1573970317840576\n",
              "   values: 0.4425300657749176\n",
              "   values: 0.4228905141353607\n",
              "   values: 1.3139126300811768\n",
              "   values: 0.052318159490823746\n",
              "   values: 0.4132472574710846\n",
              "   values: 0.0019512200960889459\n",
              "   values: 0.5427330136299133\n",
              "   values: 0.4568560719490051\n",
              "   values: 0.9155091643333435\n",
              "   values: 0.21765978634357452\n",
              "   values: 0.11430477350950241\n",
              "   values: 0.34715715050697327\n",
              "   values: 0.3005385100841522\n",
              "   values: 0.09495500475168228\n",
              "   values: 0.12728634476661682\n",
              "   values: 0.8997484445571899\n",
              "   values: 0.3982778787612915\n",
              "   values: 0.11951763927936554\n",
              "   values: 0.08692999184131622\n",
              "   values: 0.30558720231056213\n",
              "   values: 0.9944084882736206\n",
              "   values: 0.34508460760116577\n",
              "   values: 0.35677260160446167\n",
              "   values: 0.9256220459938049\n",
              "   values: 0.15359249711036682\n",
              "   values: 0.06429435312747955\n",
              "   values: 0.083342544734478\n",
              "   values: 0.35334911942481995\n",
              "   values: 0.0842406153678894\n",
              "   values: 0.18978065252304077\n",
              "   values: 1.151856780052185\n",
              "   values: 0.450652539730072\n",
              "   values: 0.47584590315818787\n",
              "   values: 0.026025565341114998\n",
              "   values: 3.016606569290161\n",
              "   values: 0.19782574474811554\n",
              "   values: 0.15526613593101501\n",
              "   values: 0.38174858689308167\n",
              "   values: 1.0271050930023193\n",
              "   values: 0.5057345628738403\n",
              "   values: 0.4770587682723999\n",
              "   values: 0.24248650670051575\n",
              "   values: 0.8699195384979248\n",
              "   values: 0.1221139207482338\n",
              "   values: 0.14433705806732178\n",
              "   values: 0.14095009863376617\n",
              "   values: 0.026976587250828743\n",
              "   values: 0.10203468054533005\n",
              "   values: 0.21687394380569458\n",
              "   values: 1.0229004621505737\n",
              "   values: 1.1375575065612793\n",
              "   values: 1.4533321857452393\n",
              "   values: 0.14264501631259918\n",
              "   values: 0.006812678650021553\n",
              "   values: 0.5186077356338501\n",
              "   values: 0.27712854743003845\n",
              "   values: 0.1332872211933136\n",
              "   values: 0.022212404757738113\n",
              "   values: 0.013579257763922215\n",
              "   values: 0.5381823778152466\n",
              "   values: 0.7018978595733643\n",
              "   values: 0.13925230503082275\n",
              "   values: 0.1602703034877777\n",
              "   values: 0.04394211992621422\n",
              "   values: 0.03360854089260101\n",
              "   values: 0.9987343549728394\n",
              "   values: 0.31845372915267944\n",
              "   values: 0.1221139207482338\n",
              "   values: 2.256213903427124\n",
              "   values: 1.531476378440857\n",
              "   values: 0.4374985992908478\n",
              "   values: 0.3526630103588104\n",
              "   values: 0.129004567861557\n",
              "   values: 0.29400965571403503\n",
              "   values: 0.02887592278420925\n",
              "   values: 0.13071982562541962\n",
              "   values: 0.5074998140335083\n",
              "   values: 2.9526290893554688\n",
              "   values: 0.20580662786960602\n",
              "   values: 0.18573370575904846\n",
              "   values: 0.0058422754518687725\n",
              "   values: 0.18978065252304077\n",
              "   values: 0.29400965571403503\n",
              "   values: 0.2447827309370041\n",
              "   values: 0.10731173306703568\n",
              "   values: 0.5272908806800842\n",
              "   values: 1.1153976917266846\n",
              "   values: 0.2852376699447632\n",
              "   values: 0.22626367211341858\n",
              "   values: 0.012615402229130268\n",
              "   values: 1.495358943939209\n",
              "   values: 0.46302130818367004\n",
              "   values: 2.3558297157287598\n",
              "   values: 1.4597045183181763\n",
              "   values: 0.08154398202896118\n",
              "   values: 1.8079044818878174\n",
              "   values: 0.3560888469219208\n",
              "   values: 1.5564985275268555\n",
              "   values: 1.385317325592041\n",
              "   values: 0.34715715050697327\n",
              "   values: 0.5957841277122498\n",
              "   values: 0.0029254043474793434\n",
              "   values: 0.3464667797088623\n",
              "   values: 0.8143964409828186\n",
              "   values: 1.3149620294570923\n",
              "   values: 0.20022670924663544\n",
              "   values: 0.7408206462860107\n",
              "   values: 0.34577593207359314\n",
              "   values: 0.03360854089260101\n",
              "   values: 0.10026945173740387\n",
              "   values: 0.6921701431274414\n",
              "   values: 0.07793712615966797\n",
              "   values: 0.129004567861557\n",
              "   values: 0.2607102394104004\n",
              "   values: 0.018384648486971855\n",
              "   values: 0.5057345628738403\n",
              "   values: 0.33675122261047363\n",
              "   values: 1.603168249130249\n",
              "   values: 1.6402095556259155\n",
              "   values: 1.3858059644699097\n",
              "   values: 1.4478377103805542\n",
              "   values: 0.3588210940361023\n",
              "   values: 2.276465654373169\n",
              " }, id: \"21645374-1\"\n",
              " values: -0.2140403836965561\n",
              " values: 0.03693467751145363\n",
              " values: -0.5417127013206482\n",
              " values: -0.038876548409461975\n",
              " values: 0.42387595772743225\n",
              " values: 0.2664526402950287\n",
              " values: 0.18257680535316467\n",
              " values: -0.09827347844839096\n",
              " values: 0.4649488031864166\n",
              " values: -0.30182749032974243\n",
              " values: 0.1101674884557724\n",
              " values: 0.01428282167762518\n",
              " values: -0.26967111229896545\n",
              " values: 0.3139297366142273\n",
              " values: 0.07200434058904648\n",
              " values: 0.530179500579834\n",
              " values: 0.2137565314769745\n",
              " values: 0.10197710990905762\n",
              " values: -0.3128334879875183\n",
              " values: -0.22778312861919403\n",
              " values: -0.1307372897863388\n",
              " values: -0.03795209899544716\n",
              " values: 0.7068777680397034\n",
              " values: 0.3876173198223114\n",
              " values: 0.11455462872982025\n",
              " values: -0.3078530430793762\n",
              " values: -0.2070026695728302\n",
              " values: -0.045225195586681366\n",
              " values: -0.11906073987483978\n",
              " values: 0.2947394549846649\n",
              " values: -0.07923198491334915\n",
              " values: 0.03948947414755821\n",
              " values: 0.16510537266731262\n",
              " values: 0.11272253096103668\n",
              " values: 0.030048687011003494\n",
              " values: 0.14480510354042053\n",
              " values: -0.0863969475030899\n",
              " values: -0.16525627672672272\n",
              " values: -0.10800258815288544\n",
              " values: -0.15566378831863403\n",
              " values: -0.27992764115333557\n",
              " values: -0.11356183141469955\n",
              " values: -0.44391632080078125\n",
              " values: 0.42369967699050903\n",
              " values: -0.22617356479167938\n",
              " values: 0.3042110204696655\n",
              " values: -1.329370379447937\n",
              " values: 0.4195023775100708\n",
              " values: -0.3001394271850586\n",
              " values: -0.2551802694797516\n",
              " values: -0.7461944222450256\n",
              " values: 0.24927553534507751\n",
              " values: 0.4972314238548279\n",
              " values: -0.04111209139227867\n",
              " values: 0.06366893649101257\n",
              " values: 0.45810046792030334\n",
              " values: -0.2110711932182312\n",
              " values: 0.46764272451400757\n",
              " values: -0.12950453162193298\n",
              " values: -0.4108702540397644\n",
              " values: 0.19169671833515167\n",
              " values: 0.20672374963760376\n",
              " values: 0.12412137538194656\n",
              " values: 0.02164090983569622\n",
              " values: 0.1904865801334381\n",
              " values: -0.1700974553823471\n",
              " values: 0.6965128183364868\n",
              " values: 0.4559090733528137\n",
              " values: 0.05077524483203888\n",
              " values: -0.1463628113269806\n",
              " values: -0.6426395773887634\n",
              " values: 0.08014655858278275\n",
              " values: 0.21900804340839386\n",
              " values: 0.22051776945590973\n",
              " values: -0.2125614583492279\n",
              " values: -0.312141090631485\n",
              " values: -0.7934592366218567\n",
              " values: 0.04036928713321686\n",
              " values: 0.33967292308807373\n",
              " values: 0.13398335874080658\n",
              " values: 0.15060225129127502\n",
              " values: 0.2135213017463684\n",
              " values: -0.2641403079032898\n",
              " values: 0.5275019407272339\n",
              " values: 0.014109645038843155\n",
              " values: -0.5283111929893494\n",
              " values: 0.2867667078971863\n",
              " values: -0.03736444190144539\n",
              " values: -0.02011394128203392\n",
              " values: 0.3242969810962677\n",
              " values: -0.3528301417827606\n",
              " values: -0.02772333472967148\n",
              " values: 0.2540786564350128\n",
              " values: 0.4723927080631256\n",
              " values: 0.2663123905658722\n",
              " values: -0.2500368356704712\n",
              " values: 0.15015079081058502\n",
              " values: -0.2692148685455322\n",
              " values: 0.31546372175216675\n",
              " values: -0.16543619334697723\n",
              " values: -0.44162243604660034\n",
              " values: -0.08390366286039352\n",
              " values: -0.10424098372459412\n",
              " values: 0.14838775992393494\n",
              " values: -0.46304529905319214\n",
              " values: -0.03402915969491005\n",
              " values: 0.10414263606071472\n",
              " values: -0.011055693961679935\n",
              " values: -0.4730255901813507\n",
              " values: 0.03592320904135704\n",
              " values: -0.0902334600687027\n",
              " values: 0.3091624975204468\n",
              " values: -0.026531875133514404\n",
              " values: -0.1466708481311798\n",
              " values: 0.12960761785507202\n",
              " values: 0.45135462284088135\n",
              " values: 0.1592910885810852\n",
              " values: -0.3664129078388214\n",
              " values: 0.030831215903162956\n",
              " values: -0.09965772181749344\n",
              " values: 0.14890536665916443\n",
              " values: 0.783787727355957\n",
              " values: -0.46042898297309875\n",
              " values: -0.08071921765804291\n",
              " values: -0.174423947930336\n",
              " values: -0.3126847445964813\n",
              " values: -0.10177236050367355\n",
              " values: -0.09643585979938507\n",
              " values: -0.16117821633815765\n",
              " values: -0.3502756655216217\n",
              " values: 0.006714189425110817\n",
              " values: -0.194378063082695\n",
              " values: 0.16769172251224518\n",
              " values: 0.06511490792036057\n",
              " values: -0.2125042825937271\n",
              " values: -0.14380225539207458\n",
              " values: 0.23805001378059387\n",
              " values: -0.026240428909659386\n",
              " values: 0.47562938928604126\n",
              " values: 0.09618883579969406\n",
              " values: -0.32507842779159546\n",
              " values: -0.41578060388565063\n",
              " values: 0.0882069393992424\n",
              " values: 0.2378438115119934\n",
              " values: 0.42611902952194214\n",
              " values: -0.4448263347148895\n",
              " values: -0.12991517782211304\n",
              " values: -0.41739267110824585\n",
              " values: -0.3069743514060974\n",
              " values: 0.06991074979305267\n",
              " values: -0.08377540856599808\n",
              " values: -0.04015588015317917\n",
              " values: -0.03389747813344002\n",
              " values: -0.5690193176269531\n",
              " values: -0.3102989196777344\n",
              " values: 0.5956598520278931\n",
              " values: 0.8452068567276001\n",
              " values: 0.04336382821202278\n",
              " values: -0.10051092505455017\n",
              " values: 0.0014935004292055964\n",
              " values: 0.0068087405525147915\n",
              " values: -0.12347360700368881\n",
              " values: -0.1479496955871582\n",
              " values: -0.12146838009357452\n",
              " values: 0.2500065565109253\n",
              " values: -0.020861616358160973\n",
              " values: 0.4076882004737854\n",
              " values: 0.2270871251821518\n",
              " values: 0.01333501748740673\n",
              " values: 0.04667815938591957\n",
              " values: -0.42385390400886536\n",
              " values: 0.4586126506328583\n",
              " values: 0.2761335074901581\n",
              " values: 0.14240902662277222\n",
              " values: -0.3829475939273834\n",
              " values: 0.05026696249842644\n",
              " values: 0.46839815378189087\n",
              " values: -0.11663825809955597\n",
              " values: 0.20249955356121063\n",
              " values: -0.11761875450611115\n",
              " values: -0.9490371942520142\n",
              " values: 0.21566416323184967\n",
              " values: -0.18476806581020355\n",
              " values: 0.5019130110740662\n",
              " values: 0.29317137598991394\n",
              " values: 0.08321989327669144\n",
              " values: 0.5348961353302002\n",
              " values: 0.07218791544437408\n",
              " values: 0.034637849777936935\n",
              " values: 0.3258683979511261\n",
              " values: -0.00577012961730361\n",
              " values: -0.025243474170565605\n",
              " values: 0.16865995526313782\n",
              " values: -0.21222561597824097\n",
              " values: 0.447170615196228\n",
              " values: 0.01572755165398121\n",
              " values: -0.03590993955731392\n",
              " values: -0.10227891802787781\n",
              " values: 0.10183361917734146\n",
              " values: 0.5989875197410583\n",
              " values: -0.7300544381141663\n",
              " values: 0.2050757110118866\n",
              " values: 0.17334726452827454\n",
              " values: -0.08398851752281189\n",
              " values: -0.08458750694990158\n",
              " values: 0.7571449279785156\n",
              " values: 0.06237122789025307\n",
              " values: -0.32092905044555664\n",
              " values: 0.44099587202072144\n",
              " values: -0.019400907680392265\n",
              " values: -0.34793323278427124\n",
              " values: -0.20036299526691437\n",
              " values: 0.3525732457637787\n",
              " values: 0.03956465423107147\n",
              " values: 0.3476327657699585\n",
              " values: -0.36168986558914185\n",
              " values: 0.3303806185722351\n",
              " values: 0.00024731765734031796\n",
              " values: -0.2144109606742859\n",
              " values: -0.6168845295906067\n",
              " values: -0.14081434905529022\n",
              " values: 0.03885776177048683\n",
              " values: 0.13612231612205505\n",
              " values: 0.558309018611908\n",
              " values: 0.06131706014275551\n",
              " values: 0.7496813535690308\n",
              " values: 0.7817664742469788\n",
              " values: -0.44154563546180725\n",
              " values: -0.03376474604010582\n",
              " values: 0.009541123174130917\n",
              " values: -0.25839996337890625\n",
              " values: -0.02909884974360466\n",
              " values: 0.05049893632531166\n",
              " values: -0.15321293473243713\n",
              " values: 0.25508081912994385\n",
              " values: 0.04371010512113571\n",
              " values: -0.39385488629341125\n",
              " values: -0.17414066195487976\n",
              " values: -0.09307132661342621\n",
              " values: -0.4661661386489868\n",
              " values: -0.002158222021535039\n",
              " values: 0.24840553104877472\n",
              " values: -0.2562817931175232\n",
              " values: 0.45597773790359497\n",
              " values: -0.08700215071439743\n",
              " values: -0.1116299256682396\n",
              " values: 0.20686060190200806\n",
              " values: -0.010019331239163876\n",
              " values: -0.4707461893558502\n",
              " values: -0.02570217102766037\n",
              " values: -0.10826714336872101\n",
              " values: -0.04874935373663902\n",
              " values: 0.12518177926540375\n",
              " values: 0.11106633394956589\n",
              " values: 0.0010760363657027483\n",
              " values: -0.3819827437400818\n",
              " values: -0.06857864558696747\n",
              " values: 0.08791858702898026\n",
              " values: 0.5691989064216614\n",
              " values: -0.04812135919928551\n",
              " values: -0.05162695795297623\n",
              " values: 0.22608375549316406\n",
              " values: 0.16677092015743256\n",
              " values: -0.2954711616039276\n",
              " values: -0.22425143420696259\n",
              " values: -0.6144866347312927\n",
              " values: -0.0019707197789102793\n",
              " values: -0.11986680328845978\n",
              " values: 0.6509312987327576\n",
              " values: -0.12532632052898407\n",
              " values: 0.6323976516723633\n",
              " values: 0.17878948152065277\n",
              " values: -0.25590386986732483\n",
              " values: -0.39170292019844055\n",
              " values: -0.11903557181358337\n",
              " values: -0.017590977251529694\n",
              " values: 0.38023993372917175\n",
              " values: 0.1459902822971344\n",
              " values: 0.12073401361703873\n",
              " values: 0.22641536593437195\n",
              " values: 0.12837375700473785\n",
              " values: 0.28447502851486206\n",
              " values: 0.07886646687984467\n",
              " values: -0.39736315608024597\n",
              " values: 0.303031861782074\n",
              " values: 0.0845167264342308\n",
              " values: -0.028735587373375893\n",
              " values: -0.8085566163063049\n",
              " values: -0.1960565149784088\n",
              " values: -0.24053610861301422\n",
              " values: 0.046195559203624725\n",
              " values: 0.19660449028015137\n",
              " values: -0.19386611878871918\n",
              " values: 0.1451111137866974\n",
              " values: -0.03891995921730995\n",
              " values: 0.11800958216190338\n",
              " values: 0.10772863775491714\n",
              " values: 0.364147812128067\n",
              " values: 0.5060978531837463\n",
              " values: 0.06892169266939163\n",
              " values: -0.05275847390294075\n",
              " values: 0.3198462128639221\n",
              " values: 0.022272534668445587\n",
              " values: 0.09098643809556961\n",
              " values: -0.04701514542102814\n",
              " values: -0.11098478734493256\n",
              " values: 0.09574614465236664\n",
              " values: -0.3857014775276184\n",
              " values: -10.730119705200195\n",
              " values: 0.226316899061203\n",
              " values: 0.02101379632949829\n",
              " values: -0.5123381614685059\n",
              " values: 0.585724413394928\n",
              " values: 0.5323572754859924\n",
              " values: 0.10494057834148407\n",
              " values: 0.016216550022363663\n",
              " values: 0.05753111094236374\n",
              " values: -0.23854993283748627\n",
              " values: -0.3195338249206543\n",
              " values: -0.26972195506095886\n",
              " values: -0.1317858099937439\n",
              " values: 0.010688325390219688\n",
              " values: 0.3278798460960388\n",
              " values: 0.0602760910987854\n",
              " values: -0.009516200050711632\n",
              " values: -0.3545137643814087\n",
              " values: -0.31893980503082275\n",
              " values: 0.19057655334472656\n",
              " values: -0.17986780405044556\n",
              " values: -0.38664281368255615\n",
              " values: -0.3119966387748718\n",
              " values: -0.250570148229599\n",
              " values: -0.07974608242511749\n",
              " values: 0.16488021612167358\n",
              " values: -0.49536725878715515\n",
              " values: -0.1980516016483307\n",
              " values: -0.5474504828453064\n",
              " values: -0.10979830473661423\n",
              " values: -0.09338121116161346\n",
              " values: -0.25015681982040405\n",
              " values: -0.014519576914608479\n",
              " values: -0.050134506076574326\n",
              " values: 0.6468101143836975\n",
              " values: -0.3849768042564392\n",
              " values: 0.3031429052352905\n",
              " values: -0.31718844175338745\n",
              " values: 0.23621457815170288\n",
              " values: -0.36258235573768616\n",
              " values: 0.024020690470933914\n",
              " values: -0.2776530086994171\n",
              " values: 0.19289210438728333\n",
              " values: 0.29935145378112793\n",
              " values: -0.07379448413848877\n",
              " values: -0.047927483916282654\n",
              " values: -0.06598849594593048\n",
              " values: 0.057523276656866074\n",
              " values: -0.08541048318147659\n",
              " values: 0.39397576451301575\n",
              " values: 0.22845888137817383\n",
              " values: 0.09306362271308899\n",
              " values: 0.7871710062026978\n",
              " values: -0.27824345231056213\n",
              " values: 0.206338033080101\n",
              " values: -0.11339627206325531\n",
              " values: 0.017935890704393387\n",
              " values: -0.00324540538713336\n",
              " values: -0.1424378752708435\n",
              " values: -0.4398519694805145\n",
              " values: -0.015277965925633907\n",
              " values: -0.3479733467102051\n",
              " values: -0.15772975981235504\n",
              " values: -0.5864155292510986\n",
              " values: 0.19802437722682953\n",
              " values: 0.12328342348337173\n",
              " values: -0.6459119319915771\n",
              " values: 0.16747723519802094\n",
              " values: 0.5364038348197937\n",
              " values: 0.19676050543785095\n",
              " values: -0.16849836707115173\n",
              " values: 0.1779717653989792\n",
              " values: -0.2887036204338074\n",
              " values: -2.500945568084717\n",
              " values: -0.30422908067703247\n",
              " values: -0.5207197666168213\n",
              " values: 0.15404513478279114\n",
              " values: -0.5401661396026611\n",
              " values: -0.13158972561359406\n",
              " values: 0.064643494784832\n",
              " values: -0.4610017240047455\n",
              " values: 0.4916447103023529\n",
              " values: 0.3277149796485901\n",
              " values: 0.25477662682533264\n",
              " values: 0.20235472917556763\n",
              " values: -0.2547036409378052\n",
              " values: -0.12278727442026138\n",
              " values: 0.053628887981176376\n",
              " values: -0.17457787692546844\n",
              " values: -0.016279244795441628\n",
              " values: 0.4132111966609955\n",
              " values: -0.4597623646259308\n",
              " values: -0.48360028862953186\n",
              " values: -0.28365713357925415\n",
              " values: 0.19705401360988617\n",
              " values: 0.5540783405303955\n",
              " values: -0.30054596066474915\n",
              " values: -0.01552525069564581\n",
              " values: 0.280399352312088\n",
              " values: -0.06801274418830872\n",
              " values: 0.4646323323249817\n",
              " values: -0.42257583141326904\n",
              " values: 0.23471461236476898\n",
              " values: 0.07099112123250961\n",
              " values: -0.212026447057724\n",
              " values: -0.0761188194155693\n",
              " values: -0.3003336787223816\n",
              " values: 0.5956431031227112\n",
              " values: 0.1415989100933075\n",
              " values: 0.33694493770599365\n",
              " values: 0.09986118972301483\n",
              " values: 0.013277971185743809\n",
              " values: 0.14809691905975342\n",
              " values: -0.5928636789321899\n",
              " values: 0.6469647288322449\n",
              " values: 0.09489565342664719\n",
              " values: 0.6062808632850647\n",
              " values: 0.3047085702419281\n",
              " values: 0.3870912790298462\n",
              " values: -0.15043634176254272\n",
              " values: -0.5211157202720642\n",
              " values: 0.008331178687512875\n",
              " values: -0.5140002965927124\n",
              " values: 0.2444097101688385\n",
              " values: -0.581861674785614\n",
              " values: 0.5680708289146423\n",
              " values: -0.011788856238126755\n",
              " values: -0.2596319615840912\n",
              " values: 0.2558527886867523\n",
              " values: 0.053915031254291534\n",
              " values: -0.3959311842918396\n",
              " values: -0.1151784211397171\n",
              " values: 0.04390915110707283\n",
              " values: 0.20302319526672363\n",
              " values: -0.07419740408658981\n",
              " values: 0.04463377967476845\n",
              " values: -0.2233658730983734\n",
              " values: -0.07331526279449463\n",
              " values: -0.2980596721172333\n",
              " values: 0.03767070919275284\n",
              " values: -0.06699489802122116\n",
              " values: 0.061956290155649185\n",
              " values: -0.15365244448184967\n",
              " values: -0.4008673131465912\n",
              " values: 0.8794193267822266\n",
              " values: 0.5266588926315308\n",
              " values: 0.11251890659332275\n",
              " values: 0.14364951848983765\n",
              " values: -0.11349190026521683\n",
              " values: -0.1572207808494568\n",
              " values: 0.19086433947086334\n",
              " values: -0.20687341690063477\n",
              " values: 0.31280457973480225\n",
              " values: 0.04673779010772705\n",
              " values: -0.3074946701526642\n",
              " values: 0.35401827096939087\n",
              " values: 0.5437186360359192\n",
              " values: -0.004562511574476957\n",
              " values: 0.471502423286438\n",
              " values: -0.3641940653324127\n",
              " values: 0.11181685328483582\n",
              " values: -0.2411622703075409\n",
              " values: -0.5206084251403809\n",
              " values: -0.3301830291748047\n",
              " values: 0.002178110647946596\n",
              " values: 0.5881955027580261\n",
              " values: 0.24471408128738403\n",
              " values: -0.38124656677246094\n",
              " values: 0.13180486857891083\n",
              " values: 0.3094942271709442\n",
              " values: -0.0656382143497467\n",
              " values: -0.13506512343883514\n",
              " values: -0.26194554567337036\n",
              " values: -0.03380327671766281\n",
              " values: 0.28378239274024963\n",
              " values: -0.11423373967409134\n",
              " values: -0.11648355424404144\n",
              " values: -0.22997143864631653\n",
              " values: 0.31639501452445984\n",
              " values: 0.5153753757476807\n",
              " values: -0.43808168172836304\n",
              " values: -0.32784292101860046\n",
              " values: 0.1812404990196228\n",
              " values: 0.07121209055185318\n",
              " values: -0.08660512417554855\n",
              " values: -0.005885673221200705\n",
              " values: -0.28918978571891785\n",
              " values: -0.5921549201011658\n",
              " values: -0.15936602652072906\n",
              " values: 0.1202096939086914\n",
              " values: 0.536738932132721\n",
              " values: 0.18225428462028503\n",
              " values: -0.12388946115970612\n",
              " values: -0.16271066665649414\n",
              " values: -0.34134307503700256\n",
              " values: -0.21477212011814117\n",
              " values: -0.29000335931777954\n",
              " values: 0.6449375152587891\n",
              " values: 0.10092218220233917\n",
              " values: -0.2573462128639221\n",
              " values: -0.5806785225868225\n",
              " values: -0.20733509957790375\n",
              " values: -0.035825617611408234\n",
              " values: 0.0012503323378041387\n",
              " values: 0.5685456395149231\n",
              " values: -0.24205900728702545\n",
              " values: 0.43410614132881165\n",
              " values: 0.01991327293217182\n",
              " values: -0.4597327411174774\n",
              " values: 0.19529883563518524\n",
              " values: -0.00983346439898014\n",
              " values: -0.20717093348503113\n",
              " values: 0.08746523410081863\n",
              " values: 0.5938265919685364\n",
              " values: -0.015848755836486816\n",
              " values: -0.09089704602956772\n",
              " values: 0.07760883122682571\n",
              " values: -0.22621236741542816\n",
              " values: -0.2509922981262207\n",
              " values: 0.04041314870119095\n",
              " values: 0.23223565518856049\n",
              " values: -0.22441145777702332\n",
              " values: -0.27126601338386536\n",
              " values: -0.46765777468681335\n",
              " values: -0.30487146973609924\n",
              " values: 0.19010485708713531\n",
              " values: -0.14516645669937134\n",
              " values: -0.22501006722450256\n",
              " values: 0.3292805254459381\n",
              " values: 0.12371016293764114\n",
              " values: -0.24252869188785553\n",
              " values: -0.09215819090604782\n",
              " values: -0.3482881784439087\n",
              " values: 0.445803701877594\n",
              " values: -0.3263317942619324\n",
              " values: -0.4256628751754761\n",
              " values: 0.023511217907071114\n",
              " values: 0.20684292912483215\n",
              " values: 0.03610917553305626\n",
              " values: 0.04228934273123741\n",
              " values: 0.3310330808162689\n",
              " values: 0.5075891017913818\n",
              " values: 0.10962262749671936\n",
              " values: 0.13607457280158997\n",
              " values: 0.11194303631782532\n",
              " values: 0.4283299148082733\n",
              " values: -0.10670001059770584\n",
              " values: -0.2829846739768982\n",
              " values: 0.02783108688890934\n",
              " values: 0.12256213277578354\n",
              " values: -0.002122485777363181\n",
              " values: -0.12457647919654846\n",
              " values: 0.0648118406534195\n",
              " values: -0.15031446516513824\n",
              " values: 0.36192652583122253\n",
              " values: -0.3951806426048279\n",
              " values: -0.19006650149822235\n",
              " values: -0.19360285997390747\n",
              " values: -0.07424117624759674\n",
              " values: 0.19714245200157166\n",
              " values: 0.032045360654592514\n",
              " values: 0.04296194016933441\n",
              " values: -0.33479994535446167\n",
              " values: 0.05376878008246422\n",
              " values: -0.12835471332073212\n",
              " values: -0.1263575255870819\n",
              " values: -0.10535098612308502\n",
              " values: -0.39255383610725403\n",
              " values: 0.6026937365531921\n",
              " values: 0.33904460072517395\n",
              " values: 0.5641025900840759\n",
              " values: 0.16654902696609497\n",
              " values: 0.2724286913871765\n",
              " values: 0.2566237151622772\n",
              " values: 0.2644397020339966\n",
              " values: -0.08388054370880127\n",
              " values: 0.19730260968208313\n",
              " values: 0.16776281595230103\n",
              " values: 0.5218631625175476\n",
              " values: -0.16858014464378357\n",
              " values: -0.23247918486595154\n",
              " values: 0.2839176058769226\n",
              " values: -0.29741930961608887\n",
              " values: -0.2755732834339142\n",
              " values: 0.27706068754196167\n",
              " values: -0.38283708691596985\n",
              " values: -0.1827917844057083\n",
              " values: 0.25954464077949524\n",
              " values: -0.30715659260749817\n",
              " values: -0.07026070356369019\n",
              " values: 0.1343056559562683\n",
              " values: 0.03890936076641083\n",
              " values: -0.10943891108036041\n",
              " values: -0.2833990156650543\n",
              " values: 0.12227630615234375\n",
              " values: 0.3417853116989136\n",
              " values: 0.8067261576652527\n",
              " values: 0.2755511701107025\n",
              " values: 0.35372161865234375\n",
              " values: 0.1375962793827057\n",
              " values: -0.7063553333282471\n",
              " values: 0.5578701496124268\n",
              " values: 0.12080775946378708\n",
              " values: -0.39315325021743774\n",
              " values: 0.1343115270137787\n",
              " values: 0.023486219346523285\n",
              " values: 0.16042114794254303\n",
              " values: -0.3588021397590637\n",
              " values: -0.20226503908634186\n",
              " values: -0.08301685750484467\n",
              " values: 0.11042292416095734\n",
              " values: -0.22824621200561523\n",
              " values: 0.391733318567276\n",
              " values: 0.11317119002342224\n",
              " values: -0.06716641783714294\n",
              " values: -0.4623725712299347\n",
              " values: 0.2428315430879593\n",
              " values: -0.25252118706703186\n",
              " values: 0.1447094976902008\n",
              " values: -0.24683862924575806\n",
              " values: 0.8234736323356628\n",
              " values: -0.14002034068107605\n",
              " values: 0.24071434140205383\n",
              " values: -0.31121620535850525\n",
              " values: 0.46199333667755127\n",
              " values: 0.24292424321174622\n",
              " values: -0.2879648506641388\n",
              " values: 0.19986380636692047\n",
              " values: 0.19151414930820465\n",
              " values: 0.7198887467384338\n",
              " values: 0.648657500743866\n",
              " values: 0.16173285245895386\n",
              " values: 0.6451312303543091\n",
              " values: 0.49767014384269714\n",
              " values: 0.14908352494239807\n",
              " values: 0.21215659379959106\n",
              " values: -0.36428481340408325\n",
              " values: -0.3649199903011322\n",
              " values: 0.007755736354738474\n",
              " values: -0.09064514935016632\n",
              " values: -0.08590181171894073\n",
              " values: 0.4502536654472351\n",
              " values: -0.1905452460050583\n",
              " values: 0.12181488424539566\n",
              " values: 0.6701012253761292\n",
              " values: 0.08059032261371613\n",
              " values: 0.30427390336990356\n",
              " values: -0.192073255777359\n",
              " values: -0.22711403667926788\n",
              " values: 0.1432688981294632\n",
              " values: 0.5454921126365662\n",
              " values: 0.1057724803686142\n",
              " values: 0.2627581059932709\n",
              " values: -0.08122552186250687\n",
              " values: 0.16517210006713867\n",
              " values: -0.1314229667186737\n",
              " values: 0.015895532444119453\n",
              " values: 0.08210030198097229\n",
              " values: -0.25594562292099\n",
              " values: 0.4114936590194702\n",
              " values: -0.4442603886127472\n",
              " values: 0.22135892510414124\n",
              " values: 0.3170751929283142\n",
              " values: 0.06210312992334366\n",
              " values: -0.0625285655260086\n",
              " values: 0.17988578975200653\n",
              " values: 0.1707456260919571\n",
              " values: 0.012760943733155727\n",
              " values: -0.1354900449514389\n",
              " values: -0.13232143223285675\n",
              " values: 0.052270375192165375\n",
              " values: -0.21111272275447845\n",
              " values: -0.15380257368087769\n",
              " values: -0.2906093895435333\n",
              " values: 0.02371387556195259\n",
              " values: -0.6173052191734314\n",
              " values: -0.037543222308158875\n",
              " values: -0.179293692111969\n",
              " values: 0.24231520295143127\n",
              " values: 0.42178910970687866\n",
              " values: 0.008427166379988194\n",
              " values: -0.47061002254486084\n",
              " values: -0.09106042981147766\n",
              " values: -0.26640594005584717\n",
              " values: -0.0921059176325798\n",
              " values: -0.42497238516807556\n",
              " values: -0.10543394833803177\n",
              " values: 0.4447559714317322\n",
              " values: -0.4690963327884674\n",
              " values: -0.04679318889975548\n",
              " values: -0.13840563595294952\n",
              " values: -0.28467825055122375\n",
              " values: 0.10587047785520554\n",
              " values: 0.1614414006471634\n",
              " values: -0.3918570280075073\n",
              " values: -0.28481778502464294\n",
              " values: 0.2874312698841095\n",
              " values: 0.070029616355896\n",
              " values: 0.7011133432388306\n",
              " values: -0.03786367177963257\n",
              " values: 0.2580190896987915\n",
              " values: 0.18803450465202332\n",
              " values: -0.1901738941669464\n",
              " values: 0.38100945949554443\n",
              " values: -0.3302043378353119\n",
              " values: 0.45517730712890625\n",
              " values: -0.4238640069961548\n",
              " values: 0.10859160870313644\n",
              " values: -0.36455637216567993\n",
              " values: 0.5210739970207214\n",
              " values: 0.3318686783313751\n",
              " values: -0.2624308466911316\n",
              " values: -0.2735561728477478\n",
              " values: 0.8001947402954102\n",
              " values: -0.3297364115715027\n",
              " values: 0.4016117751598358\n",
              " values: 0.16104260087013245\n",
              " values: -0.3789854645729065\n",
              " values: 0.2576184570789337\n",
              " values: -0.5060696005821228\n",
              " values: -0.3046902120113373\n",
              " values: -0.18355685472488403\n",
              " values: 0.346314400434494\n",
              " values: 0.9559329152107239\n",
              " values: -0.4547050893306732\n",
              " values: 0.47016414999961853\n",
              " values: 0.36422741413116455\n",
              " values: 0.1875220090150833\n",
              " values: -0.1956125944852829\n",
              " values: 0.5794529318809509\n",
              " values: -0.03467132896184921\n",
              " values: 0.22290174663066864\n",
              " values: -0.36957666277885437\n",
              " values: -0.18436329066753387\n",
              " values: 0.10378331691026688\n",
              " values: -0.7196213603019714\n",
              " values: -0.3600570857524872\n",
              " values: 0.30411815643310547\n",
              " values: -0.18476255238056183\n",
              " values: -0.3690936863422394\n",
              " values: -0.2169446051120758\n",
              " values: 0.05944250151515007\n",
              " values: 0.1383129209280014\n",
              " values: -0.30981433391571045\n",
              " values: -0.04516684636473656\n",
              " values: -0.23233893513679504\n",
              " values: -0.4411790668964386\n",
              " values: -0.4721142053604126\n",
              " values: -0.06950055062770844\n",
              " values: -0.30514004826545715\n",
              " values: -0.003933437634259462\n",
              " values: 0.05711275711655617\n",
              " values: -0.09010234475135803\n",
              " values: 0.07090166211128235\n",
              " values: 0.22051535546779633\n",
              " values: -0.2206849306821823\n",
              " values: -0.10750636458396912\n",
              " values: 0.229884073138237\n",
              " values: 0.3567584156990051\n",
              " values: 0.19745485484600067\n",
              " metadata {\n",
              "   fields {\n",
              "     key: \"context\"\n",
              "     value {\n",
              "       string_value: \"The leaves of the plant consist of a latticework of longitudinal and transverse veins enclosing areoles. PCD occurs in the cells at the center of these areoles and progresses outwards, stopping approximately five cells from the vasculature. The role of mitochondria during PCD has been recognized in animals; however, it has been less studied during PCD in plants. The following paper elucidates the role of mitochondrial dynamics during developmentally regulated PCD in vivo in A.\"\n",
              "     }\n",
              "   }\n",
              " }\n",
              " sparse_values {\n",
              "   indices: 1999\n",
              "   indices: 2012\n",
              "   indices: 2024\n",
              "   indices: 2042\n",
              "   indices: 2043\n",
              "   indices: 2076\n",
              "   indices: 2081\n",
              "   indices: 2094\n",
              "   indices: 2116\n",
              "   indices: 2135\n",
              "   indices: 2173\n",
              "   indices: 2179\n",
              "   indices: 2284\n",
              "   indices: 2415\n",
              "   indices: 2458\n",
              "   indices: 2535\n",
              "   indices: 2597\n",
              "   indices: 2644\n",
              "   indices: 2749\n",
              "   indices: 2754\n",
              "   indices: 2803\n",
              "   indices: 2817\n",
              "   indices: 2875\n",
              "   indices: 2920\n",
              "   indices: 3030\n",
              "   indices: 3252\n",
              "   indices: 3269\n",
              "   indices: 3273\n",
              "   indices: 3274\n",
              "   indices: 3295\n",
              "   indices: 3392\n",
              "   indices: 3426\n",
              "   indices: 3466\n",
              "   indices: 3526\n",
              "   indices: 3603\n",
              "   indices: 3605\n",
              "   indices: 3727\n",
              "   indices: 3853\n",
              "   indices: 3858\n",
              "   indices: 4044\n",
              "   indices: 4111\n",
              "   indices: 4176\n",
              "   indices: 4195\n",
              "   indices: 4224\n",
              "   indices: 4264\n",
              "   indices: 4360\n",
              "   indices: 4372\n",
              "   indices: 4395\n",
              "   indices: 4442\n",
              "   indices: 4574\n",
              "   indices: 4758\n",
              "   indices: 5082\n",
              "   indices: 5090\n",
              "   indices: 5098\n",
              "   indices: 5158\n",
              "   indices: 5258\n",
              "   indices: 5383\n",
              "   indices: 5397\n",
              "   indices: 5398\n",
              "   indices: 5812\n",
              "   indices: 6198\n",
              "   indices: 6470\n",
              "   indices: 6552\n",
              "   indices: 6741\n",
              "   indices: 7053\n",
              "   indices: 7337\n",
              "   indices: 7403\n",
              "   indices: 7458\n",
              "   indices: 7461\n",
              "   indices: 7473\n",
              "   indices: 7551\n",
              "   indices: 7775\n",
              "   indices: 7816\n",
              "   indices: 8477\n",
              "   indices: 8524\n",
              "   indices: 8676\n",
              "   indices: 8765\n",
              "   indices: 8790\n",
              "   indices: 8979\n",
              "   indices: 9004\n",
              "   indices: 9007\n",
              "   indices: 9232\n",
              "   indices: 9607\n",
              "   indices: 9890\n",
              "   indices: 10066\n",
              "   indices: 10210\n",
              "   indices: 10507\n",
              "   indices: 10949\n",
              "   indices: 11568\n",
              "   indices: 11663\n",
              "   indices: 12222\n",
              "   indices: 12328\n",
              "   indices: 12436\n",
              "   indices: 12506\n",
              "   indices: 12818\n",
              "   indices: 13656\n",
              "   indices: 13908\n",
              "   indices: 14194\n",
              "   indices: 14685\n",
              "   indices: 14772\n",
              "   indices: 14774\n",
              "   indices: 15176\n",
              "   indices: 15422\n",
              "   indices: 15436\n",
              "   indices: 15923\n",
              "   indices: 16844\n",
              "   indices: 17779\n",
              "   indices: 18323\n",
              "   indices: 18426\n",
              "   indices: 18551\n",
              "   indices: 18606\n",
              "   indices: 19137\n",
              "   indices: 20051\n",
              "   indices: 20134\n",
              "   indices: 20437\n",
              "   indices: 20464\n",
              "   indices: 20546\n",
              "   indices: 21198\n",
              "   indices: 21225\n",
              "   indices: 22869\n",
              "   indices: 23079\n",
              "   indices: 23555\n",
              "   indices: 23909\n",
              "   indices: 24054\n",
              "   indices: 24269\n",
              "   indices: 25714\n",
              "   indices: 27480\n",
              "   indices: 28086\n",
              "   indices: 28290\n",
              "   indices: 28817\n",
              "   indices: 29111\n",
              "   values: 0.30989447236061096\n",
              "   values: 0.007782140281051397\n",
              "   values: 1.367565393447876\n",
              "   values: 0.04860413447022438\n",
              "   values: 0.05970508232712746\n",
              "   values: 1.1198691129684448\n",
              "   values: 0.08692999184131622\n",
              "   values: 1.62340247631073\n",
              "   values: 0.5168620347976685\n",
              "   values: 0.06154331564903259\n",
              "   values: 0.6793810129165649\n",
              "   values: 0.14518201351165771\n",
              "   values: 0.2470736801624298\n",
              "   values: 1.0927356481552124\n",
              "   values: 0.38041436672210693\n",
              "   values: 1.3017656803131104\n",
              "   values: 0.8143964409828186\n",
              "   values: 0.9162907600402832\n",
              "   values: 0.06246116757392883\n",
              "   values: 0.2105647772550583\n",
              "   values: 0.19381128251552582\n",
              "   values: 0.36697331070899963\n",
              "   values: 0.18816383183002472\n",
              "   values: 0.034552380442619324\n",
              "   values: 0.6563454270362854\n",
              "   values: 0.7009293437004089\n",
              "   values: 1.190008521080017\n",
              "   values: 0.5838727951049805\n",
              "   values: 0.006812678650021553\n",
              "   values: 0.5215105414390564\n",
              "   values: 0.13670019805431366\n",
              "   values: 0.04113444685935974\n",
              "   values: 0.27044451236724854\n",
              "   values: 0.9409833550453186\n",
              "   values: 0.058784693479537964\n",
              "   values: 0.2674594223499298\n",
              "   values: 1.4017986059188843\n",
              "   values: 0.6197150945663452\n",
              "   values: 0.5562619566917419\n",
              "   values: 0.055094651877880096\n",
              "   values: 0.8004589080810547\n",
              "   values: 1.1524739265441895\n",
              "   values: 0.24325250089168549\n",
              "   values: 0.02887592278420925\n",
              "   values: 1.2210142612457275\n",
              "   values: 0.947819709777832\n",
              "   values: 0.637939989566803\n",
              "   values: 0.7398891448974609\n",
              "   values: 1.0172666311264038\n",
              "   values: 0.6773988008499146\n",
              "   values: 0.42161011695861816\n",
              "   values: 0.5607312321662903\n",
              "   values: 0.004870930220931768\n",
              "   values: 0.3464667797088623\n",
              "   values: 0.08871890604496002\n",
              "   values: 1.318103313446045\n",
              "   values: 0.012615402229130268\n",
              "   values: 0.7305257320404053\n",
              "   values: 0.15359249711036682\n",
              "   values: 0.603290855884552\n",
              "   values: 1.2742929458618164\n",
              "   values: 0.12470348179340363\n",
              "   values: 0.3269403576850891\n",
              "   values: 0.4132472574710846\n",
              "   values: 1.0628231763839722\n",
              "   values: 0.5506471395492554\n",
              "   values: 0.17759032547473907\n",
              "   values: 0.17020416259765625\n",
              "   values: 0.23247487843036652\n",
              "   values: 2.7352802753448486\n",
              "   values: 0.013579257763922215\n",
              "   values: 0.11430477350950241\n",
              "   values: 0.7473171949386597\n",
              "   values: 0.02792670577764511\n",
              "   values: 0.981317400932312\n",
              "   values: 0.9915141463279724\n",
              "   values: 0.05694137513637543\n",
              "   values: 0.056018441915512085\n",
              "   values: 0.6233867406845093\n",
              "   values: 0.09050461649894714\n",
              "   values: 0.3388410806655884\n",
              "   values: 0.5127768516540527\n",
              "   values: 1.102510929107666\n",
              "   values: 1.4812493324279785\n",
              "   values: 0.11256109178066254\n",
              "   values: 1.8046963214874268\n",
              "   values: 0.06977381557226181\n",
              "   values: 1.551543951034546\n",
              "   values: 0.1485546976327896\n",
              "   values: 1.244919776916504\n",
              "   values: 1.3540414571762085\n",
              "   values: 0.5573811531066895\n",
              "   values: 0.9893379211425781\n",
              "   values: 0.25467249751091003\n",
              "   values: 0.6212902665138245\n",
              "   values: 0.1485546976327896\n",
              "   values: 1.17624831199646\n",
              "   values: 0.15359249711036682\n",
              "   values: 0.056018441915512085\n",
              "   values: 0.32270604372024536\n",
              "   values: 0.2231435477733612\n",
              "   values: 0.4041621685028076\n",
              "   values: 1.5272444486618042\n",
              "   values: 1.2916187047958374\n",
              "   values: 0.2493593990802765\n",
              "   values: 0.014542185701429844\n",
              "   values: 1.838811993598938\n",
              "   values: 1.4094613790512085\n",
              "   values: 0.15693697333335876\n",
              "   values: 0.06612417846918106\n",
              "   values: 0.8306987881660461\n",
              "   values: 0.056018441915512085\n",
              "   values: 1.2035820484161377\n",
              "   values: 1.5507158041000366\n",
              "   values: 0.3191637098789215\n",
              "   values: 0.9432673454284668\n",
              "   values: 0.630689799785614\n",
              "   values: 0.010684899985790253\n",
              "   values: 0.09228714555501938\n",
              "   values: 0.6451379656791687\n",
              "   values: 1.7884989976882935\n",
              "   values: 0.03266380727291107\n",
              "   values: 0.22937409579753876\n",
              "   values: 0.3027053773403168\n",
              "   values: 1.7040376663208008\n",
              "   values: 0.20421554148197174\n",
              "   values: 0.32058215141296387\n",
              "   values: 0.27786844968795776\n",
              "   values: 0.018384648486971855\n",
              "   values: 1.5101354122161865\n",
              "   values: 1.417065978050232\n",
              " }, id: \"21645374-2\"\n",
              " values: -0.27513086795806885\n",
              " values: 0.07915674895048141\n",
              " values: -0.5472765564918518\n",
              " values: -0.06628616154193878\n",
              " values: 0.25865450501441956\n",
              " values: 0.08726669102907181\n",
              " values: 0.3006037175655365\n",
              " values: -0.4698793888092041\n",
              " values: 0.41297781467437744\n",
              " values: -0.3055749535560608\n",
              " values: 0.11293364316225052\n",
              " values: 0.19629956781864166\n",
              " values: -0.15968357026576996\n",
              " values: 0.25697335600852966\n",
              " values: 0.22218714654445648\n",
              " values: 0.5392282009124756\n",
              " values: 0.357484370470047\n",
              " values: 0.122161865234375\n",
              " values: -0.2336413860321045\n",
              " values: -0.11822862923145294\n",
              " values: -0.37616628408432007\n",
              " values: 0.14979417622089386\n",
              " values: 0.6385562419891357\n",
              " values: 0.3163781762123108\n",
              " values: 0.01167222298681736\n",
              " values: -0.401179701089859\n",
              " values: 0.10464273393154144\n",
              " values: -0.11668888479471207\n",
              " values: -0.08659574389457703\n",
              " values: 0.24334987998008728\n",
              " values: -0.007476962171494961\n",
              " values: 0.0008916801307350397\n",
              " values: 0.09627681970596313\n",
              " values: 0.23037876188755035\n",
              " values: -0.141321063041687\n",
              " values: 0.06550147384405136\n",
              " values: -0.18239255249500275\n",
              " values: -0.17547741532325745\n",
              " values: -0.1329975724220276\n",
              " values: -0.2614981234073639\n",
              " values: -0.07550925761461258\n",
              " values: 0.002034611301496625\n",
              " values: -0.3691112995147705\n",
              " values: 0.5016622543334961\n",
              " values: -0.2533307671546936\n",
              " values: 0.2259230762720108\n",
              " values: -1.2329456806182861\n",
              " values: 0.2959984540939331\n",
              " values: -0.19638307392597198\n",
              " values: -0.43741533160209656\n",
              " values: -0.6615935564041138\n",
              " values: 0.29271942377090454\n",
              " values: 0.6432257294654846\n",
              " values: -0.0268971286714077\n",
              " values: 0.037467774003744125\n",
              " values: 0.27703413367271423\n",
              " values: -0.3674348294734955\n",
              " values: 0.3522001802921295\n",
              " values: -0.1637718230485916\n",
              " values: -0.2664872407913208\n",
              " values: 0.3073355257511139\n",
              " values: 0.18099819123744965\n",
              " values: 0.008609013631939888\n",
              " values: 0.06058146432042122\n",
              " values: 0.30313584208488464\n",
              " values: -0.24883264303207397\n",
              " values: 0.8705857992172241\n",
              " values: 0.5051458477973938\n",
              " values: -0.061983779072761536\n",
              " values: -0.21916738152503967\n",
              " values: -0.37255221605300903\n",
              " values: -0.031287044286727905\n",
              " values: 0.11577687412500381\n",
              " values: 0.10236630588769913\n",
              " values: -0.2655591070652008\n",
              " values: -0.2947448790073395\n",
              " values: -0.5321796536445618\n",
              " values: 0.05982015281915665\n",
              " values: 0.3733212351799011\n",
              " values: 0.23484019935131073\n",
              " values: 0.286930650472641\n",
              " values: 0.09188330918550491\n",
              " values: 0.005112663842737675\n",
              " values: 0.2602892518043518\n",
              " values: -0.022869156673550606\n",
              " values: -0.40679407119750977\n",
              " values: 0.3312484323978424\n",
              " values: -0.10994915664196014\n",
              " values: -0.16930757462978363\n",
              " values: 0.20592541992664337\n",
              " values: -0.245756134390831\n",
              " values: 0.007303519174456596\n",
              " values: 0.15315678715705872\n",
              " values: 0.43210849165916443\n",
              " values: 0.08449526131153107\n",
              " values: -0.13469983637332916\n",
              " values: 0.18486091494560242\n",
              " values: -0.2548154592514038\n",
              " values: 0.5101104378700256\n",
              " values: -0.3500666320323944\n",
              " values: -0.3594009578227997\n",
              " values: -0.22787202894687653\n",
              " values: -0.16299831867218018\n",
              " values: 0.04147055372595787\n",
              " values: -0.5421410202980042\n",
              " values: -0.001778959296643734\n",
              " values: -0.011968954466283321\n",
              " values: -0.16703420877456665\n",
              " values: -0.6153042912483215\n",
              " values: 0.12860597670078278\n",
              " values: -0.16451865434646606\n",
              " values: 0.21440696716308594\n",
              " values: 0.00928443018347025\n",
              " values: -0.19974428415298462\n",
              " values: 0.21500647068023682\n",
              " values: 0.46564146876335144\n",
              " values: 0.19887161254882812\n",
              " values: -0.3176337778568268\n",
              " values: -0.22834686934947968\n",
              " values: 0.053618401288986206\n",
              " values: 0.39556002616882324\n",
              " values: 0.6794195175170898\n",
              " values: -0.42769837379455566\n",
              " values: 0.028490372002124786\n",
              " values: -0.19710780680179596\n",
              " values: -0.29234451055526733\n",
              " values: 0.003741433145478368\n",
              " values: 0.049614060670137405\n",
              " values: -0.1332603096961975\n",
              " values: -0.1282479465007782\n",
              " values: 0.241302028298378\n",
              " values: -0.18845640122890472\n",
              " values: 0.11928986012935638\n",
              " values: 0.052286118268966675\n",
              " values: -0.26081016659736633\n",
              " values: -0.09927580505609512\n",
              " values: 0.08928096294403076\n",
              " values: -0.1491156816482544\n",
              " values: 0.4891628324985504\n",
              " values: -0.03561568260192871\n",
              " values: -0.31021398305892944\n",
              " values: -0.45608198642730713\n",
              " values: 0.12541282176971436\n",
              " values: 0.2857266664505005\n",
              " values: 0.35953715443611145\n",
              " values: -0.29430413246154785\n",
              " values: -0.14105942845344543\n",
              " values: -0.5161268711090088\n",
              " values: -0.31664609909057617\n",
              " values: -0.07978668063879013\n",
              " values: -0.18359829485416412\n",
              " values: -0.12385088950395584\n",
              " values: -0.284381240606308\n",
              " values: -0.5573969483375549\n",
              " values: -0.23923321068286896\n",
              " values: 0.7034366726875305\n",
              " values: 0.6567585468292236\n",
              " values: -0.04031798243522644\n",
              " values: -0.16288691759109497\n",
              " values: 0.1293381154537201\n",
              " values: 0.1546059250831604\n",
              " values: -0.15871301293373108\n",
              " values: -0.3192211985588074\n",
              " values: -0.07881999760866165\n",
              " values: 0.45613786578178406\n",
              " values: -0.0343099907040596\n",
              " values: 0.09421601891517639\n",
              " values: 0.40928974747657776\n",
              " values: 0.16172046959400177\n",
              " values: -0.07870342582464218\n",
              " values: -0.5255063772201538\n",
              " values: 0.4870923161506653\n",
              " values: 0.32216376066207886\n",
              " values: 0.28938937187194824\n",
              " values: -0.42462363839149475\n",
              " values: 0.18055446445941925\n",
              " values: 0.44755348563194275\n",
              " values: -0.09581258147954941\n",
              " values: 0.22831040620803833\n",
              " values: -0.23380222916603088\n",
              " values: -0.975325345993042\n",
              " values: 0.1829630434513092\n",
              " values: -0.05853348970413208\n",
              " values: 0.5354565382003784\n",
              " values: 0.2434559166431427\n",
              " values: 0.1870407909154892\n",
              " values: 0.3888814449310303\n",
              " values: 0.08521762490272522\n",
              " values: 0.024184497073292732\n",
              " values: 0.1940923035144806\n",
              " values: -0.175991028547287\n",
              " values: -0.14515386521816254\n",
              " values: 0.3021456301212311\n",
              " values: -0.12384051084518433\n",
              " values: 0.6559321880340576\n",
              " values: 0.026921408250927925\n",
              " values: 0.19645819067955017\n",
              " values: 0.08205443620681763\n",
              " values: 0.22727610170841217\n",
              " values: 0.5658060312271118\n",
              " values: -0.5743606686592102\n",
              " values: 0.09078793227672577\n",
              " values: 0.08526258170604706\n",
              " values: 0.04565397650003433\n",
              " values: -0.16809673607349396\n",
              " values: 0.7452421188354492\n",
              " values: 0.08030316233634949\n",
              " values: -0.28508397936820984\n",
              " values: 0.34465575218200684\n",
              " values: 0.025968307629227638\n",
              " values: -0.1895366758108139\n",
              " values: -0.21436642110347748\n",
              " values: 0.44887906312942505\n",
              " values: 0.025432484224438667\n",
              " values: 0.2295404076576233\n",
              " values: -0.28123739361763\n",
              " values: 0.21364940702915192\n",
              " values: -0.05497127026319504\n",
              " values: -0.24121417105197906\n",
              " values: -0.5235603451728821\n",
              " values: -0.17787861824035645\n",
              " values: 0.023939045146107674\n",
              " values: 0.3693470060825348\n",
              " values: 0.628466784954071\n",
              " values: 0.15588660538196564\n",
              " values: 0.818436861038208\n",
              " values: 0.7864820957183838\n",
              " values: -0.5354521870613098\n",
              " values: 0.21587593853473663\n",
              " values: -0.035207223147153854\n",
              " values: -0.2884802222251892\n",
              " values: -0.2321113497018814\n",
              " values: -0.13835282623767853\n",
              " values: -0.15273189544677734\n",
              " values: 0.3614022135734558\n",
              " values: 0.16512808203697205\n",
              " values: -0.2301425039768219\n",
              " values: -0.3341673016548157\n",
              " values: 0.1363314986228943\n",
              " values: -0.549480140209198\n",
              " values: -0.2052609771490097\n",
              " values: 0.32241612672805786\n",
              " values: -0.002417933428660035\n",
              " values: 0.5432217717170715\n",
              " values: -0.030235091224312782\n",
              " values: 0.015572612173855305\n",
              " values: 0.18695399165153503\n",
              " values: 0.0743395984172821\n",
              " values: -0.353934109210968\n",
              " values: 0.019045986235141754\n",
              " values: -0.05105220898985863\n",
              " values: -0.0027295297477394342\n",
              " values: 0.25503918528556824\n",
              " values: 0.039806757122278214\n",
              " values: 0.18009889125823975\n",
              " values: -0.4041624963283539\n",
              " values: -0.14764411747455597\n",
              " values: -0.045686401426792145\n",
              " values: 0.3828110694885254\n",
              " values: -0.11171482503414154\n",
              " values: 0.018342552706599236\n",
              " values: 0.13186608254909515\n",
              " values: 0.08659166097640991\n",
              " values: -0.33911997079849243\n",
              " values: -0.16263876855373383\n",
              " values: -0.6247025728225708\n",
              " values: -0.06200601905584335\n",
              " values: -0.144722118973732\n",
              " values: 0.4905380606651306\n",
              " values: 0.08404459804296494\n",
              " values: 0.5237507820129395\n",
              " values: 0.04143058508634567\n",
              " values: -0.1797652393579483\n",
              " values: -0.40538525581359863\n",
              " values: -0.20383931696414948\n",
              " values: 0.14913833141326904\n",
              " values: 0.394491046667099\n",
              " values: 0.24026961624622345\n",
              " values: 0.27454015612602234\n",
              " values: 0.07640485465526581\n",
              " values: -0.02805960737168789\n",
              " values: 0.3391912877559662\n",
              " values: 0.21407027542591095\n",
              " values: -0.26765677332878113\n",
              " values: 0.19372577965259552\n",
              " values: -0.05013648048043251\n",
              " values: -0.1946827620267868\n",
              " values: -0.9417623281478882\n",
              " values: -0.0846162736415863\n",
              " values: -0.4950253367424011\n",
              " values: 0.06402479857206345\n",
              " values: 0.03256931155920029\n",
              " values: -0.17021788656711578\n",
              " values: 0.18926458060741425\n",
              " values: -0.09969225525856018\n",
              " values: -0.021024508401751518\n",
              " values: 0.07091248035430908\n",
              " values: 0.5194622874259949\n",
              " values: 0.22276075184345245\n",
              " values: 0.08240476995706558\n",
              " values: -0.007494449615478516\n",
              " values: 0.4992983043193817\n",
              " values: -0.10514064133167267\n",
              " values: 0.22339555621147156\n",
              " values: -0.10779967904090881\n",
              " values: 0.07702205330133438\n",
              " values: 0.058197394013404846\n",
              " values: -0.48802560567855835\n",
              " values: -10.630866050720215\n",
              " values: 0.13491451740264893\n",
              " values: 0.12543204426765442\n",
              " values: -0.5108441710472107\n",
              " values: 0.5800114274024963\n",
              " values: 0.5451002717018127\n",
              " values: 0.2617293894290924\n",
              " values: -0.06601502746343613\n",
              " values: -0.007467202376574278\n",
              " values: -0.19927898049354553\n",
              " values: -0.17150183022022247\n",
              " values: -0.2839054763317108\n",
              " values: -0.1466241478919983\n",
              " values: 0.04644109308719635\n",
              " values: 0.3915620744228363\n",
              " values: -0.13140909373760223\n",
              " values: 0.03197116404771805\n",
              " values: -0.3818919062614441\n",
              " values: -0.23548632860183716\n",
              " values: 0.3436550199985504\n",
              " values: -0.32989346981048584\n",
              " values: -0.3882692754268646\n",
              " values: -0.5499271154403687\n",
              " values: -0.38646364212036133\n",
              " values: -0.20082427561283112\n",
              " values: -0.06660633534193039\n",
              " values: -0.300668865442276\n",
              " values: -0.09748796373605728\n",
              " values: -0.7245107889175415\n",
              " values: -0.09319128841161728\n",
              " values: -0.06374350190162659\n",
              " values: -0.2343970388174057\n",
              " values: 0.07251812517642975\n",
              " values: 0.06400219351053238\n",
              " values: 0.7401305437088013\n",
              " values: -0.16449162364006042\n",
              " values: 0.4647628366947174\n",
              " values: -0.24968193471431732\n",
              " values: 0.1861811727285385\n",
              " values: -0.3735719919204712\n",
              " values: -0.19914637506008148\n",
              " values: -0.5081645250320435\n",
              " values: 0.2569241225719452\n",
              " values: 0.40173009037971497\n",
              " values: -0.13985183835029602\n",
              " values: 0.00247529917396605\n",
              " values: 0.03697149083018303\n",
              " values: 0.08634158968925476\n",
              " values: -0.2687837779521942\n",
              " values: 0.5452585816383362\n",
              " values: 0.13651615381240845\n",
              " values: 0.07067176699638367\n",
              " values: 0.5723428130149841\n",
              " values: -0.1368248611688614\n",
              " values: 0.36836525797843933\n",
              " values: -0.21386979520320892\n",
              " values: 0.10328131169080734\n",
              " values: 0.1524164229631424\n",
              " values: -0.20164518058300018\n",
              " values: -0.2236386388540268\n",
              " values: -0.03627772629261017\n",
              " values: -0.39826497435569763\n",
              " values: -0.1429806351661682\n",
              " values: -0.5175440907478333\n",
              " values: 0.02824207954108715\n",
              " values: 0.22245070338249207\n",
              " values: -0.7772012948989868\n",
              " values: 0.11328067630529404\n",
              " values: 0.3456636667251587\n",
              " values: 0.13717639446258545\n",
              " values: -0.3805753290653229\n",
              " values: 0.02111176587641239\n",
              " values: -0.1876121312379837\n",
              " values: -2.385063409805298\n",
              " values: -0.25566425919532776\n",
              " values: -0.4180736839771271\n",
              " values: 0.07655761390924454\n",
              " values: -0.4919065237045288\n",
              " values: -0.08419327437877655\n",
              " values: 0.1795918196439743\n",
              " values: -0.36412954330444336\n",
              " values: 0.35630279779434204\n",
              " values: 0.25537794828414917\n",
              " values: 0.021617908030748367\n",
              " values: -0.009715912863612175\n",
              " values: -0.18673478066921234\n",
              " values: -0.05137190222740173\n",
              " values: 0.18420493602752686\n",
              " values: -0.29843950271606445\n",
              " values: -0.015663450583815575\n",
              " values: 0.5099023580551147\n",
              " values: -0.46472278237342834\n",
              " values: -0.5400570631027222\n",
              " values: -0.2982995808124542\n",
              " values: 0.28770822286605835\n",
              " values: 0.5652551054954529\n",
              " values: -0.1713498830795288\n",
              " values: 0.2727229595184326\n",
              " values: 0.17831113934516907\n",
              " values: -0.2722691297531128\n",
              " values: 0.35074716806411743\n",
              " values: -0.39679399132728577\n",
              " values: 0.16986165940761566\n",
              " values: 0.2774013578891754\n",
              " values: 0.15457378327846527\n",
              " values: -0.0751841589808464\n",
              " values: -0.16648603975772858\n",
              " values: 0.6661807894706726\n",
              " values: 0.22044245898723602\n",
              " values: 0.1577686220407486\n",
              " values: 0.14944909512996674\n",
              " values: 0.12279533594846725\n",
              " values: 0.12816980481147766\n",
              " values: -0.583010196685791\n",
              " values: 0.7503891587257385\n",
              " values: 0.034114766865968704\n",
              " values: 0.48770758509635925\n",
              " values: 0.17402483522891998\n",
              " values: 0.5807642936706543\n",
              " values: -0.17214584350585938\n",
              " values: -0.7422757148742676\n",
              " values: -0.1009056493639946\n",
              " values: -0.5107493996620178\n",
              " values: 0.3296784460544586\n",
              " values: -0.7350150942802429\n",
              " values: 0.5398520231246948\n",
              " values: 0.19193993508815765\n",
              " values: -0.41736462712287903\n",
              " values: 0.03946438804268837\n",
              " values: -0.021929336711764336\n",
              " values: -0.5188812017440796\n",
              " values: -0.03866896033287048\n",
              " values: -0.13987216353416443\n",
              " values: 0.09679773449897766\n",
              " values: 0.012547318823635578\n",
              " values: -0.0895344465970993\n",
              " values: -0.18943312764167786\n",
              " values: -0.23561961948871613\n",
              " values: -0.40928834676742554\n",
              " values: 0.013146048411726952\n",
              " values: -0.25770798325538635\n",
              " values: -0.03142419084906578\n",
              " values: -0.12607212364673615\n",
              " values: -0.5727706551551819\n",
              " values: 0.7317667007446289\n",
              " values: 0.3628988564014435\n",
              " values: 0.1563793271780014\n",
              " values: 0.42438140511512756\n",
              " values: -0.06304453313350677\n",
              " values: -0.04185836389660835\n",
              " values: 0.18610544502735138\n",
              " values: -0.4409485459327698\n",
              " values: 0.43720534443855286\n",
              " values: 0.007404603064060211\n",
              " values: -0.47210022807121277\n",
              " values: 0.3168868124485016\n",
              " values: 0.6111452579498291\n",
              " values: 0.005638078320771456\n",
              " values: 0.5743243098258972\n",
              " values: -0.6137526631355286\n",
              " values: 0.2661723494529724\n",
              " values: -0.20683276653289795\n",
              " values: -0.5110723376274109\n",
              " values: -0.20149095356464386\n",
              " values: 0.10930002480745316\n",
              " values: 0.8362971544265747\n",
              " values: 0.34938621520996094\n",
              " values: -0.3963679373264313\n",
              " values: 0.07331647723913193\n",
              " values: 0.3364182114601135\n",
              " values: -0.006025858223438263\n",
              " values: -0.18792890012264252\n",
              " values: -0.4796016812324524\n",
              " values: -0.07988396286964417\n",
              " values: 0.17823204398155212\n",
              " values: -0.06055781617760658\n",
              " values: -0.03424596041440964\n",
              " values: -0.14844359457492828\n",
              " values: 0.018616607412695885\n",
              " values: 0.655678927898407\n",
              " values: -0.5446072816848755\n",
              " values: -0.350350946187973\n",
              " values: 0.2307179868221283\n",
              " values: 0.15739372372627258\n",
              " values: -0.1429404616355896\n",
              " values: 0.002833315869793296\n",
              " values: -0.12480998784303665\n",
              " values: -0.40792548656463623\n",
              " values: -0.18931137025356293\n",
              " values: 0.12986737489700317\n",
              " values: 0.4528123140335083\n",
              " values: 0.36653706431388855\n",
              " values: -0.008956830948591232\n",
              " values: -0.050123121589422226\n",
              " values: -0.1894606649875641\n",
              " values: -0.3669082820415497\n",
              " values: -0.12735873460769653\n",
              " values: 0.6277720928192139\n",
              " values: 0.2263280749320984\n",
              " values: -0.35685041546821594\n",
              " values: -0.6335331797599792\n",
              " values: -0.2259768694639206\n",
              " values: -0.10322084277868271\n",
              " values: -0.057112012058496475\n",
              " values: 0.6274338364601135\n",
              " values: -0.11450553685426712\n",
              " values: 0.3975026309490204\n",
              " values: -0.09218880534172058\n",
              " values: -0.24593913555145264\n",
              " values: 0.1402079463005066\n",
              " values: 0.1621696949005127\n",
              " values: -0.14617714285850525\n",
              " values: -0.10974545031785965\n",
              " values: 0.5870515704154968\n",
              " values: 0.1798839420080185\n",
              " values: -0.07634741067886353\n",
              " values: 0.09611737728118896\n",
              " values: -0.2834400236606598\n",
              " values: -0.34651824831962585\n",
              " values: -0.029460005462169647\n",
              " values: 0.2030424177646637\n",
              " values: -0.10238993912935257\n",
              " values: -0.2216007113456726\n",
              " values: -0.45529869198799133\n",
              " values: -0.3234861493110657\n",
              " values: 0.21039728820323944\n",
              " values: -0.21982042491436005\n",
              " values: -0.05655822530388832\n",
              " values: 0.3544900715351105\n",
              " values: 0.038563232868909836\n",
              " values: -0.17593656480312347\n",
              " values: -0.19822083413600922\n",
              " values: -0.25416895747184753\n",
              " values: 0.4950510561466217\n",
              " values: -0.5596703290939331\n",
              " values: -0.5718705058097839\n",
              " values: 0.005063176155090332\n",
              " values: 0.18879789113998413\n",
              " values: -0.060812655836343765\n",
              " values: -0.06938136368989944\n",
              " values: 0.17831063270568848\n",
              " values: 0.5987139940261841\n",
              " values: -0.1504473239183426\n",
              " values: 0.17383307218551636\n",
              " values: -0.0835070088505745\n",
              " values: 0.3761083781719208\n",
              " values: -0.23651480674743652\n",
              " values: -0.23400971293449402\n",
              " values: -0.08844263106584549\n",
              " values: 0.2752527594566345\n",
              " values: -0.125620037317276\n",
              " values: -0.07920226454734802\n",
              " values: -0.03177165240049362\n",
              " values: -0.059061843901872635\n",
              " values: 0.44091030955314636\n",
              " values: -0.4440363943576813\n",
              " values: -0.2019461989402771\n",
              " values: -0.038328785449266434\n",
              " values: 0.020419247448444366\n",
              " values: 0.21798919141292572\n",
              " values: 0.0006821086863055825\n",
              " values: 0.2620921730995178\n",
              " values: -0.34789034724235535\n",
              " values: 0.21379809081554413\n",
              " values: -0.17428544163703918\n",
              " values: -0.1164092868566513\n",
              " values: -0.14505110681056976\n",
              " values: -0.37194904685020447\n",
              " values: 0.4887055456638336\n",
              " values: 0.17797726392745972\n",
              " values: 0.3183555603027344\n",
              " values: 0.223404660820961\n",
              " values: 0.2929422855377197\n",
              " values: 0.2643956243991852\n",
              " values: 0.34466618299484253\n",
              " values: -0.2698635160923004\n",
              " values: 0.16928018629550934\n",
              " values: -0.0014301780611276627\n",
              " values: 0.5606415271759033\n",
              " values: -0.11557566374540329\n",
              " values: -0.09733016043901443\n",
              " values: 0.3237398564815521\n",
              " values: -0.30116403102874756\n",
              " values: -0.3351391553878784\n",
              " values: 0.2091033160686493\n",
              " values: -0.43277040123939514\n",
              " values: -0.29432833194732666\n",
              " values: -0.014230724424123764\n",
              " values: -0.3213757276535034\n",
              " values: -0.2872563302516937\n",
              " values: 0.2502489984035492\n",
              " values: 0.06883665174245834\n",
              " values: -0.07684479653835297\n",
              " values: -0.3171085715293884\n",
              " values: 0.1624021679162979\n",
              " values: 0.2804964482784271\n",
              " values: 0.983113169670105\n",
              " values: 0.22063781321048737\n",
              " values: 0.24967600405216217\n",
              " values: 0.07132107019424438\n",
              " values: -0.7142696976661682\n",
              " values: 0.5765827298164368\n",
              " values: 0.27668994665145874\n",
              " values: -0.2859639525413513\n",
              " values: 0.30669063329696655\n",
              " values: 0.19661864638328552\n",
              " values: 0.13778316974639893\n",
              " values: -0.5231835842132568\n",
              " values: -0.11592303216457367\n",
              " values: -0.30910468101501465\n",
              " values: -0.016177451238036156\n",
              " values: -0.2536831796169281\n",
              " values: 0.3195965886116028\n",
              " values: 0.07053470611572266\n",
              " values: -0.0092471269890666\n",
              " values: -0.03659701719880104\n",
              " values: 0.48162713646888733\n",
              " values: -0.14681974053382874\n",
              " values: 0.129806786775589\n",
              " values: -0.29220885038375854\n",
              " values: 0.8300013542175293\n",
              " values: -0.317122220993042\n",
              " values: 0.21913683414459229\n",
              " values: -0.272870272397995\n",
              " values: 0.23744060099124908\n",
              " values: 0.04818226397037506\n",
              " values: -0.5671125054359436\n",
              " values: 0.3362838625907898\n",
              " values: 0.31147295236587524\n",
              " values: 0.457484632730484\n",
              " values: 0.6402359008789062\n",
              " values: 0.3838382959365845\n",
              " values: 0.5746403932571411\n",
              " values: 0.5586086511611938\n",
              " values: 0.16938693821430206\n",
              " values: 0.15047337114810944\n",
              " values: -0.11991472542285919\n",
              " values: -0.4668784439563751\n",
              " values: -0.03181992843747139\n",
              " values: 0.13799558579921722\n",
              " values: 0.14570225775241852\n",
              " values: 0.4079076647758484\n",
              " values: -0.2321302741765976\n",
              " values: 0.4763127565383911\n",
              " values: 0.5815671682357788\n",
              " values: -0.0772988349199295\n",
              " values: 0.11861760169267654\n",
              " values: -0.18076357245445251\n",
              " values: -0.21011602878570557\n",
              " values: 0.32657891511917114\n",
              " values: 0.40151190757751465\n",
              " values: 0.2491370439529419\n",
              " values: 0.11010449379682541\n",
              " values: -0.23805762827396393\n",
              " values: 0.23601998388767242\n",
              " values: -0.08460316807031631\n",
              " values: 0.2113410085439682\n",
              " values: -0.0293341763317585\n",
              " values: -0.2927679419517517\n",
              " values: 0.40194422006607056\n",
              " values: -0.3740604519844055\n",
              " values: 0.13727736473083496\n",
              " values: 0.4462847411632538\n",
              " values: 0.20419920980930328\n",
              " values: -0.10664186626672745\n",
              " values: 0.1292642503976822\n",
              " values: 0.09536971151828766\n",
              " values: -0.030709760263562202\n",
              " values: 0.12364330887794495\n",
              " values: -0.14151760935783386\n",
              " values: 0.13485725224018097\n",
              " values: -0.25742748379707336\n",
              " values: -0.00917749758809805\n",
              " values: -0.325327068567276\n",
              " values: 0.21641582250595093\n",
              " values: -0.7230833172798157\n",
              " values: 0.02581324614584446\n",
              " values: -0.18159452080726624\n",
              " values: 0.05975239351391792\n",
              " values: 0.11029110848903656\n",
              " values: -0.05601741746068001\n",
              " values: -0.633070707321167\n",
              " values: -0.003142895642668009\n",
              " values: -0.2477159947156906\n",
              " values: -0.026414992287755013\n",
              " values: -0.3608774244785309\n",
              " values: 0.06434288620948792\n",
              " values: 0.7087571024894714\n",
              " values: -0.526368260383606\n",
              " values: 0.06611165404319763\n",
              " values: -0.11679397523403168\n",
              " values: -0.26130935549736023\n",
              " values: 0.061223022639751434\n",
              " values: 0.3729001581668854\n",
              " values: -0.44067448377609253\n",
              " values: -0.25471723079681396\n",
              " values: 0.4089021384716034\n",
              " values: 0.11947011202573776\n",
              " values: 0.6799277663230896\n",
              " values: -0.07567452639341354\n",
              " values: 0.14783409237861633\n",
              " values: 0.3658706545829773\n",
              " values: -0.4774104356765747\n",
              " values: 0.14985522627830505\n",
              " values: -0.049856554716825485\n",
              " values: 0.5556055307388306\n",
              " values: -0.5018850564956665\n",
              " values: 0.20162007212638855\n",
              " values: -0.44401785731315613\n",
              " values: 0.4850544333457947\n",
              " values: 0.3971337676048279\n",
              " values: -0.4053361713886261\n",
              " values: -0.18652445077896118\n",
              " values: 0.8748052716255188\n",
              " values: -0.2243722826242447\n",
              " values: 0.41177982091903687\n",
              " values: 0.3471338450908661\n",
              " values: -0.2937156856060028\n",
              " values: 0.13671325147151947\n",
              " values: -0.6151284575462341\n",
              " values: -0.3696998357772827\n",
              " values: -0.38273727893829346\n",
              " values: 0.5006431341171265\n",
              " values: 0.9460868239402771\n",
              " values: -0.3981039524078369\n",
              " values: 0.573366105556488\n",
              " values: 0.28125500679016113\n",
              " values: 0.08241453766822815\n",
              " values: -0.5245137810707092\n",
              " values: 0.40948474407196045\n",
              " values: -0.04220206290483475\n",
              " values: 0.3038358986377716\n",
              " values: -0.17598222196102142\n",
              " values: -0.2403324842453003\n",
              " values: 0.17135608196258545\n",
              " values: -0.5415127873420715\n",
              " values: -0.27549993991851807\n",
              " values: 0.20701855421066284\n",
              " values: 0.15019328892230988\n",
              " values: -0.4257414937019348\n",
              " values: -0.261112242937088\n",
              " values: 0.1705731451511383\n",
              " values: 0.40563809871673584\n",
              " values: -0.1479320228099823\n",
              " values: -0.184043288230896\n",
              " values: -0.29600435495376587\n",
              " values: -0.13698743283748627\n",
              " values: -0.6020670533180237\n",
              " values: -0.013519280590116978\n",
              " values: -0.32724592089653015\n",
              " values: 0.03471250459551811\n",
              " values: -0.16667863726615906\n",
              " values: -0.1398690938949585\n",
              " values: -0.04306551814079285\n",
              " values: 0.15401838719844818\n",
              " values: -0.21843759715557098\n",
              " values: -0.041113339364528656\n",
              " values: 0.05307714641094208\n",
              " values: 0.46749839186668396\n",
              " values: 0.26148977875709534\n",
              " metadata {\n",
              "   fields {\n",
              "     key: \"context\"\n",
              "     value {\n",
              "       string_value: \"The role of mitochondria during PCD has been recognized in animals; however, it has been less studied during PCD in plants. The following paper elucidates the role of mitochondrial dynamics during developmentally regulated PCD in vivo in A. madagascariensis. A single areole within a window stage leaf (PCD is occurring) was divided into three areas based on the progression of PCD; cells that will not undergo PCD (NPCD), cells in early stages of PCD (EPCD), and cells in late stages of PCD (LPCD).\"\n",
              "     }\n",
              "   }\n",
              " }\n",
              " sparse_values {\n",
              "   indices: 1999\n",
              "   indices: 2024\n",
              "   indices: 2025\n",
              "   indices: 2042\n",
              "   indices: 2043\n",
              "   indices: 2076\n",
              "   indices: 2093\n",
              "   indices: 2094\n",
              "   indices: 2101\n",
              "   indices: 2135\n",
              "   indices: 2173\n",
              "   indices: 2174\n",
              "   indices: 2179\n",
              "   indices: 2306\n",
              "   indices: 2309\n",
              "   indices: 2397\n",
              "   indices: 2427\n",
              "   indices: 2458\n",
              "   indices: 2470\n",
              "   indices: 2535\n",
              "   indices: 2748\n",
              "   indices: 2749\n",
              "   indices: 2752\n",
              "   indices: 2754\n",
              "   indices: 2817\n",
              "   indices: 2913\n",
              "   indices: 2920\n",
              "   indices: 3041\n",
              "   indices: 3221\n",
              "   indices: 3252\n",
              "   indices: 3269\n",
              "   indices: 3273\n",
              "   indices: 3332\n",
              "   indices: 3449\n",
              "   indices: 3466\n",
              "   indices: 3526\n",
              "   indices: 3603\n",
              "   indices: 3645\n",
              "   indices: 3677\n",
              "   indices: 3727\n",
              "   indices: 3739\n",
              "   indices: 3853\n",
              "   indices: 3858\n",
              "   indices: 3948\n",
              "   indices: 4044\n",
              "   indices: 4111\n",
              "   indices: 4146\n",
              "   indices: 4176\n",
              "   indices: 4264\n",
              "   indices: 4360\n",
              "   indices: 4395\n",
              "   indices: 4403\n",
              "   indices: 4442\n",
              "   indices: 4574\n",
              "   indices: 4758\n",
              "   indices: 4958\n",
              "   indices: 5082\n",
              "   indices: 5258\n",
              "   indices: 5340\n",
              "   indices: 5701\n",
              "   indices: 5711\n",
              "   indices: 5812\n",
              "   indices: 6230\n",
              "   indices: 6388\n",
              "   indices: 6552\n",
              "   indices: 6622\n",
              "   indices: 6948\n",
              "   indices: 7053\n",
              "   indices: 7337\n",
              "   indices: 7403\n",
              "   indices: 7461\n",
              "   indices: 7473\n",
              "   indices: 7551\n",
              "   indices: 7775\n",
              "   indices: 7816\n",
              "   indices: 8288\n",
              "   indices: 8523\n",
              "   indices: 8524\n",
              "   indices: 8765\n",
              "   indices: 8790\n",
              "   indices: 9004\n",
              "   indices: 9007\n",
              "   indices: 9307\n",
              "   indices: 9350\n",
              "   indices: 9601\n",
              "   indices: 9890\n",
              "   indices: 10066\n",
              "   indices: 10210\n",
              "   indices: 10266\n",
              "   indices: 10327\n",
              "   indices: 10660\n",
              "   indices: 10949\n",
              "   indices: 11663\n",
              "   indices: 11934\n",
              "   indices: 12222\n",
              "   indices: 12328\n",
              "   indices: 12562\n",
              "   indices: 13070\n",
              "   indices: 13595\n",
              "   indices: 13656\n",
              "   indices: 13908\n",
              "   indices: 14194\n",
              "   indices: 14446\n",
              "   indices: 14772\n",
              "   indices: 14774\n",
              "   indices: 14967\n",
              "   indices: 14996\n",
              "   indices: 15176\n",
              "   indices: 15422\n",
              "   indices: 15485\n",
              "   indices: 15923\n",
              "   indices: 16221\n",
              "   indices: 16622\n",
              "   indices: 16844\n",
              "   indices: 18426\n",
              "   indices: 18551\n",
              "   indices: 19137\n",
              "   indices: 19797\n",
              "   indices: 20863\n",
              "   indices: 21198\n",
              "   indices: 21618\n",
              "   indices: 22869\n",
              "   indices: 23079\n",
              "   indices: 23614\n",
              "   indices: 24054\n",
              "   indices: 24269\n",
              "   indices: 25714\n",
              "   indices: 26835\n",
              "   indices: 27382\n",
              "   indices: 27480\n",
              "   indices: 27806\n",
              "   indices: 27937\n",
              "   indices: 28086\n",
              "   values: 0.3683255612850189\n",
              "   values: 0.6327666640281677\n",
              "   values: 0.17020416259765625\n",
              "   values: 0.20102575421333313\n",
              "   values: 0.055094651877880096\n",
              "   values: 1.3175804615020752\n",
              "   values: 0.1229778528213501\n",
              "   values: 1.340332269668579\n",
              "   values: 0.22937409579753876\n",
              "   values: 0.5882205963134766\n",
              "   values: 0.07793712615966797\n",
              "   values: 0.09495500475168228\n",
              "   values: 0.23247487843036652\n",
              "   values: 0.2852376699447632\n",
              "   values: 0.8534175157546997\n",
              "   values: 0.8925741910934448\n",
              "   values: 0.39762192964553833\n",
              "   values: 0.5607312321662903\n",
              "   values: 0.10818854719400406\n",
              "   values: 1.4569785594940186\n",
              "   values: 0.20739519596099854\n",
              "   values: 0.2247048318386078\n",
              "   values: 0.20580662786960602\n",
              "   values: 0.7791815400123596\n",
              "   values: 0.4873090982437134\n",
              "   values: 0.0842406153678894\n",
              "   values: 0.16110190749168396\n",
              "   values: 0.9147270321846008\n",
              "   values: 0.056018441915512085\n",
              "   values: 0.29109421372413635\n",
              "   values: 1.0702182054519653\n",
              "   values: 0.7144040465354919\n",
              "   values: 1.4883290529251099\n",
              "   values: 0.5080875158309937\n",
              "   values: 0.13243216276168823\n",
              "   values: 0.7746911644935608\n",
              "   values: 0.15442965924739838\n",
              "   values: 1.0312920808792114\n",
              "   values: 0.026025565341114998\n",
              "   values: 1.013020396232605\n",
              "   values: 0.06795065850019455\n",
              "   values: 0.7665573358535767\n",
              "   values: 0.8135309815406799\n",
              "   values: 0.4196864068508148\n",
              "   values: 0.0752234235405922\n",
              "   values: 0.9591107368469238\n",
              "   values: 0.0770333781838417\n",
              "   values: 1.2605451345443726\n",
              "   values: 1.2791962623596191\n",
              "   values: 1.005902886390686\n",
              "   values: 0.8707374930381775\n",
              "   values: 0.025073638185858727\n",
              "   values: 0.9287132620811462\n",
              "   values: 0.4512746334075928\n",
              "   values: 0.5174443125724792\n",
              "   values: 1.1744394302368164\n",
              "   values: 0.24859806895256042\n",
              "   values: 0.7047978043556213\n",
              "   values: 0.04207121208310127\n",
              "   values: 0.09406650811433792\n",
              "   values: 0.812664806842804\n",
              "   values: 0.6170841455459595\n",
              "   values: 0.2674594223499298\n",
              "   values: 0.037378571927547455\n",
              "   values: 0.3554046154022217\n",
              "   values: 0.043007105588912964\n",
              "   values: 1.5712167024612427\n",
              "   values: 1.2341761589050293\n",
              "   values: 0.52266925573349\n",
              "   values: 0.3325583338737488\n",
              "   values: 0.17431432008743286\n",
              "   values: 2.464517831802368\n",
              "   values: 0.08871890604496002\n",
              "   values: 0.26820653676986694\n",
              "   values: 0.8450632095336914\n",
              "   values: 0.15693697333335876\n",
              "   values: 0.14602625370025635\n",
              "   values: 1.2047537565231323\n",
              "   values: 0.04674193635582924\n",
              "   values: 0.32553088665008545\n",
              "   values: 0.25845035910606384\n",
              "   values: 0.42990362644195557\n",
              "   values: 0.16359257698059082\n",
              "   values: 0.0913962796330452\n",
              "   values: 0.5116065740585327\n",
              "   values: 2.174396514892578\n",
              "   values: 0.9929623603820801\n",
              "   values: 1.861533284187317\n",
              "   values: 0.006812678650021553\n",
              "   values: 0.5607312321662903\n",
              "   values: 0.05046287178993225\n",
              "   values: 1.6125580072402954\n",
              "   values: 1.1911962032318115\n",
              "   values: 2.2780683040618896\n",
              "   values: 1.3950450420379639\n",
              "   values: 0.4855078160762787\n",
              "   values: 0.14686977863311768\n",
              "   values: 0.11517547070980072\n",
              "   values: 1.0782235860824585\n",
              "   values: 0.3499138653278351\n",
              "   values: 1.3227969408035278\n",
              "   values: 0.8845420479774475\n",
              "   values: 0.18573370575904846\n",
              "   values: 0.39893341064453125\n",
              "   values: 0.3019835948944092\n",
              "   values: 0.3339579105377197\n",
              "   values: 0.18004031479358673\n",
              "   values: 0.5033760666847229\n",
              "   values: 1.569591999053955\n",
              "   values: 0.15610189735889435\n",
              "   values: 0.6075552701950073\n",
              "   values: 0.38174858689308167\n",
              "   values: 0.3757305145263672\n",
              "   values: 0.06429435312747955\n",
              "   values: 0.15275461971759796\n",
              "   values: 0.18816383183002472\n",
              "   values: 0.1619328260421753\n",
              "   values: 2.0195796489715576\n",
              "   values: 0.09761575609445572\n",
              "   values: 0.3388410806655884\n",
              "   values: 0.06337817758321762\n",
              "   values: 0.7746911644935608\n",
              "   values: 1.9244767427444458\n",
              "   values: 0.004870930220931768\n",
              "   values: 0.7018978595733643\n",
              "   values: 1.9324268102645874\n",
              "   values: 0.24554696679115295\n",
              "   values: 0.3423145115375519\n",
              "   values: 1.6109992265701294\n",
              "   values: 0.39367714524269104\n",
              "   values: 1.8181021213531494\n",
              "   values: 1.7995415925979614\n",
              "   values: 0.36290550231933594\n",
              " }]"
            ]
          },
          "execution_count": 20,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "builder(data[:3])"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "zFZMIMSsMWEa"
      },
      "source": [
        "Now we initialize our connection to Pinecone using a [free API key](https://app.pinecone.io/)."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 21,
      "metadata": {
        "id": "eZUkGOhaMWEa"
      },
      "outputs": [],
      "source": [
        "from pinecone import Pinecone\n",
        "\n",
        "pinecone.init(\n",
        "    api_key=\"YOUR_API_KEY\",  # app.pinecone.io\n",
        "    environment=\"YOUR_ENV\"  # next to api key in console\n",
        ")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "HqGy4noRMWEa"
      },
      "source": [
        "Then create a new sparse-dense enabled index (this requires `metric=\"dotproduct\"` and `pod_type` to be `p1` or `s1`."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 22,
      "metadata": {
        "id": "QCiptN3MMWEa"
      },
      "outputs": [],
      "source": [
        "index_name = 'pubmed-splade'\n",
        "\n",
        "pinecone.create_index(\n",
        "    index_name,\n",
        "    dimension=dim,\n",
        "    metric=\"dotproduct\",\n",
        "    pod_type=\"s1\"\n",
        ")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "tX1qEvgH_QR_"
      },
      "source": [
        "Initialize with `Index` or `Index`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 23,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "rZ2L50SaMWEa",
        "outputId": "0eed96af-96ea-4f49-e75a-d89b7ef0a869"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "{'dimension': 768,\n",
              " 'index_fullness': 0.0,\n",
              " 'namespaces': {},\n",
              " 'total_vector_count': 0}"
            ]
          },
          "execution_count": 23,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "index = pinecone.Index(index_name)\n",
        "index.describe_index_stats()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "pS8MeczMMWEa"
      },
      "source": [
        "Upsert to sparse-dense is simple:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 24,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "4g9w-IbMMWEb",
        "outputId": "470cdcde-e5a3-4b92-a5a7-76f519b4a840"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "upserted_count: 3"
            ]
          },
          "execution_count": 24,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "index.upsert(builder(data[:3]))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "nUQdXuOmMWEb"
      },
      "source": [
        "We can repeat this and iterate through (and index) the full dataset:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 25,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 49,
          "referenced_widgets": [
            "20e62440b2704ccd9fe905f34b87a855",
            "aaf9ebffe5d44165b906b0f8527c1baa",
            "c1a53019f20c43f5adcde4a372f96520",
            "8811aafcec354de9b4d63b09604ac4ee",
            "dfa283eae24349e48a5a55c130c7fdb6",
            "38ea675129d448c9aeb19fdf0305585c",
            "4b31cb7b15a6475fadd8d9e97287b08b",
            "023ea10fe4f64f4986f31c485fb10c97",
            "9e9b9223b4994473aeb4b89a9abdd099",
            "fb5d3cfa047541e3b4d876d8f8987956",
            "d52986695b2b4acf807e7d8f5b4e84ce"
          ]
        },
        "id": "HYtODvnaMWEb",
        "outputId": "4f23145b-4c88-4f42-ab2d-6610d14ad152"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.jupyter.widget-view+json": {
              "model_id": "20e62440b2704ccd9fe905f34b87a855",
              "version_major": 2,
              "version_minor": 0
            },
            "text/plain": [
              "  0%|          | 0/93 [00:00<?, ?it/s]"
            ]
          },
          "metadata": {},
          "output_type": "display_data"
        }
      ],
      "source": [
        "from tqdm.auto import tqdm\n",
        "\n",
        "batch_size = 64\n",
        "\n",
        "for i in tqdm(range(0, len(data), batch_size)):\n",
        "    # extract batch of data\n",
        "    i_end = min(i+batch_size, len(data))\n",
        "    batch = data[i:i_end]\n",
        "    # pass data to builder and upsert\n",
        "    index.upsert(builder(data[i:i+batch_size]))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "9eA5wYtjMWEb"
      },
      "source": [
        "We can check the number of upserted records aligns with the length of `data`."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 26,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "JxOOe-NjMWEb",
        "outputId": "472500ae-ba1a-4460-f589-c6eb59255544"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "(5930, {'dimension': 768,\n",
              "  'index_fullness': 0.0,\n",
              "  'namespaces': {'': {'vector_count': 5930}},\n",
              "  'total_vector_count': 5930})"
            ]
          },
          "execution_count": 26,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "len(data), index.describe_index_stats()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "FmFpsTOoMWEb"
      },
      "source": [
        "And now we can move on to querying...\n",
        "\n",
        "## Queries\n",
        "\n",
        "Our queries need to contain both dense and sparse vectors, we will define a function `encode` to handle the construction of vectors from text."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 27,
      "metadata": {
        "id": "Fw4czXHYMWEb"
      },
      "outputs": [],
      "source": [
        "def encode(text: str):\n",
        "    # create dense vec\n",
        "    dense_vec = dense_model.encode(text).tolist()\n",
        "    # create sparse vec\n",
        "    input_ids = tokenizer(text, return_tensors='pt')\n",
        "    with torch.no_grad():\n",
        "        sparse_vec = sparse_model(\n",
        "            d_kwargs=input_ids.to(device)\n",
        "        )['d_rep'].squeeze()\n",
        "    # convert to dictionary format\n",
        "    indices = sparse_vec.nonzero().squeeze().cpu().tolist()\n",
        "    values = sparse_vec[indices].cpu().tolist()\n",
        "    sparse_dict = {\"indices\": indices, \"values\": values}\n",
        "    # return vecs\n",
        "    return dense_vec, sparse_dict"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 37,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Q2jYbq1fKg2V",
        "outputId": "2695f8a3-9698-423d-9ae5-f5920d112266"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "{'matches': [{'id': '19156007-0',\n",
              "              'metadata': {'context': 'To investigate whether the Patient '\n",
              "                                      'Health Questionnaire-9 (PHQ-9) '\n",
              "                                      'possesses the essential psychometric '\n",
              "                                      'characteristics to measure depressive '\n",
              "                                      'symptoms in people with visual '\n",
              "                                      'impairment. The PHQ-9 scale was '\n",
              "                                      'completed by 103 participants with low '\n",
              "                                      'vision. These data were then assessed '\n",
              "                                      'for fit to the Rasch model. The '\n",
              "                                      \"participants' mean +/- standard \"\n",
              "                                      'deviation (SD) age was 74.7 +/- 12.2 '\n",
              "                                      'years.'},\n",
              "              'score': 203.74826,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []},\n",
              "             {'id': '18832500-1',\n",
              "              'metadata': {'context': 'Findings from the Sequenced Treatments '\n",
              "                                      'Alternatives to Relieve Depression '\n",
              "                                      '(STAR*D) emphasized the importance of '\n",
              "                                      'measurement-based care for the '\n",
              "                                      'treatment of depression as a key '\n",
              "                                      'ingredient for achieving response and '\n",
              "                                      'remission; yet measurement-based care '\n",
              "                                      'approaches are not commonly used in '\n",
              "                                      'clinical practice. The Nine-Item '\n",
              "                                      'Patient Health Questionnaire (PHQ-9) '\n",
              "                                      'for monitoring depression severity was '\n",
              "                                      'introduced in 19 diverse psychiatric '\n",
              "                                      'practices. During the one-year course '\n",
              "                                      'of the project the helpfulness and '\n",
              "                                      'feasibility of implementation of PHQ-9 '\n",
              "                                      'in these psychiatric practices were '\n",
              "                                      'studied.'},\n",
              "              'score': 195.72917,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []}],\n",
              " 'namespace': ''}"
            ]
          },
          "execution_count": 37,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "query = \"Can clinicians use the PHQ-9 to assess depression in people with vision loss?\"\n",
        "dense, sparse = encode(query)\n",
        "# query\n",
        "xc = index.query(\n",
        "    vector=dense,\n",
        "    sparse_vector=sparse,\n",
        "    top_k=2,  # how many results to return\n",
        "    include_metadata=True\n",
        ")\n",
        "xc"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "mPFTeF9JJJS4"
      },
      "source": [
        "We get three answers that talk about **PHQ-9** and **depression**, but only the first result is relevant to our specific scenario of these items for people with **vision loss**. This is a strong result. However, how much of this is down to the sparse vs dense components?\n",
        "\n",
        "We can actually modify the dense and sparse vectors being used to query, so that we _\"weight\"_ one or the other to be more/less important.\n",
        "\n",
        "We set a scaling value `alpha` and implement it so that when `alpha == 0` we are doing a pure **sparse** search, and when `alpha == 1` we are doing a pure **dense** search."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 38,
      "metadata": {
        "id": "Kog6Z66vIsoy"
      },
      "outputs": [],
      "source": [
        "def hybrid_scale(dense, sparse, alpha: float):\n",
        "    # check alpha value is in range\n",
        "    if alpha < 0 or alpha > 1:\n",
        "        raise ValueError(\"Alpha must be between 0 and 1\")\n",
        "    # scale sparse and dense vectors to create hybrid search vecs\n",
        "    hsparse = {\n",
        "        'indices': sparse['indices'],\n",
        "        'values':  [v * (1 - alpha) for v in sparse['values']]\n",
        "    }\n",
        "    hdense = [v * alpha for v in dense]\n",
        "    return hdense, hsparse"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "wynFJfcgKTP-"
      },
      "source": [
        "Let's try a pure dense search:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 39,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Y17RJQpMKSmJ",
        "outputId": "feadee0f-f5f2-4557-8d24-124db132879c"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "{'matches': [{'id': '19156007-0',\n",
              "              'metadata': {'context': 'To investigate whether the Patient '\n",
              "                                      'Health Questionnaire-9 (PHQ-9) '\n",
              "                                      'possesses the essential psychometric '\n",
              "                                      'characteristics to measure depressive '\n",
              "                                      'symptoms in people with visual '\n",
              "                                      'impairment. The PHQ-9 scale was '\n",
              "                                      'completed by 103 participants with low '\n",
              "                                      'vision. These data were then assessed '\n",
              "                                      'for fit to the Rasch model. The '\n",
              "                                      \"participants' mean +/- standard \"\n",
              "                                      'deviation (SD) age was 74.7 +/- 12.2 '\n",
              "                                      'years.'},\n",
              "              'score': 181.90709,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []},\n",
              "             {'id': '18832500-2',\n",
              "              'metadata': {'context': 'The Nine-Item Patient Health '\n",
              "                                      'Questionnaire (PHQ-9) for monitoring '\n",
              "                                      'depression severity was introduced in '\n",
              "                                      '19 diverse psychiatric practices. '\n",
              "                                      'During the one-year course of the '\n",
              "                                      'project the helpfulness and feasibility '\n",
              "                                      'of implementation of PHQ-9 in these '\n",
              "                                      'psychiatric practices were studied. The '\n",
              "                                      'project was modeled after the Institute '\n",
              "                                      'for Healthcare Improvement Breakthrough '\n",
              "                                      'Series. Two of the 19 practices dropped '\n",
              "                                      'out during the course of the project.'},\n",
              "              'score': 177.55069,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []}],\n",
              " 'namespace': ''}"
            ]
          },
          "execution_count": 39,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "hdense, hsparse = hybrid_scale(dense, sparse, alpha=1.0)\n",
        "# query\n",
        "xc = index.query(\n",
        "    vector=hdense,\n",
        "    sparse_vector=hsparse,\n",
        "    top_k=2,  # how many results to return\n",
        "    include_metadata=True\n",
        ")\n",
        "xc"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "sNhccZXjLkDk"
      },
      "source": [
        "Dense is actually performing very well here, let's try a full sparse search:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 40,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "HizBAbPHLUGX",
        "outputId": "b741f2ee-a080-4e88-ecd1-c3ea5bf2c998"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "{'matches': [{'id': '19156007-0',\n",
              "              'metadata': {'context': 'To investigate whether the Patient '\n",
              "                                      'Health Questionnaire-9 (PHQ-9) '\n",
              "                                      'possesses the essential psychometric '\n",
              "                                      'characteristics to measure depressive '\n",
              "                                      'symptoms in people with visual '\n",
              "                                      'impairment. The PHQ-9 scale was '\n",
              "                                      'completed by 103 participants with low '\n",
              "                                      'vision. These data were then assessed '\n",
              "                                      'for fit to the Rasch model. The '\n",
              "                                      \"participants' mean +/- standard \"\n",
              "                                      'deviation (SD) age was 74.7 +/- 12.2 '\n",
              "                                      'years.'},\n",
              "              'score': 21.841171,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []},\n",
              "             {'id': '18832500-1',\n",
              "              'metadata': {'context': 'Findings from the Sequenced Treatments '\n",
              "                                      'Alternatives to Relieve Depression '\n",
              "                                      '(STAR*D) emphasized the importance of '\n",
              "                                      'measurement-based care for the '\n",
              "                                      'treatment of depression as a key '\n",
              "                                      'ingredient for achieving response and '\n",
              "                                      'remission; yet measurement-based care '\n",
              "                                      'approaches are not commonly used in '\n",
              "                                      'clinical practice. The Nine-Item '\n",
              "                                      'Patient Health Questionnaire (PHQ-9) '\n",
              "                                      'for monitoring depression severity was '\n",
              "                                      'introduced in 19 diverse psychiatric '\n",
              "                                      'practices. During the one-year course '\n",
              "                                      'of the project the helpfulness and '\n",
              "                                      'feasibility of implementation of PHQ-9 '\n",
              "                                      'in these psychiatric practices were '\n",
              "                                      'studied.'},\n",
              "              'score': 18.634329,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []}],\n",
              " 'namespace': ''}"
            ]
          },
          "execution_count": 40,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "hdense, hsparse = hybrid_scale(dense, sparse, alpha=0.0)\n",
        "# query\n",
        "xc = index.query(\n",
        "    vector=hdense,\n",
        "    sparse_vector=hsparse,\n",
        "    top_k=2,  # how many results to return\n",
        "    include_metadata=True\n",
        ")\n",
        "xc"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "7_1uvMZDLzW3"
      },
      "source": [
        "In this scenario, both models are returning good results. But we can see variation in the results and their respective scores when switching between more or less sparse-vs-dense."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 41,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "38SynFbpLqpA",
        "outputId": "355aaf4e-bdd9-44bc-f87e-b2c7b9986ddb"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "{'matches': [{'id': '12442934-0',\n",
              "              'metadata': {'context': 'To determine whether prior exposure of '\n",
              "                                      'non-steroidal anti-inflammatory drugs '\n",
              "                                      'increases perioperative blood loss '\n",
              "                                      'associated with major orthopaedic '\n",
              "                                      'surgery. Fifty patients scheduled for '\n",
              "                                      'total hip replacement were allocated to '\n",
              "                                      'two groups (double blind, randomized '\n",
              "                                      'manner). All patients were pretreated '\n",
              "                                      'for 2 weeks before surgery: Group 1 '\n",
              "                                      'with placebo drug, Group 2 with '\n",
              "                                      'ibuprofen. All patients were injected '\n",
              "                                      'intrathecally with bupivacaine 20mg '\n",
              "                                      'plus morphine 0.'},\n",
              "              'score': 23.911129,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []},\n",
              "             {'id': '12442934-3',\n",
              "              'metadata': {'context': ' The perioperative blood loss increased '\n",
              "                                      'by 45% in the ibuprofen group compared '\n",
              "                                      'with placebo. The total (+/-SD) blood '\n",
              "                                      'loss in the ibuprofen group was 1161 '\n",
              "                                      '(+/-472) mL versus 796 (+/-337) mL in '\n",
              "                                      'the placebo group.'},\n",
              "              'score': 21.25808,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []}],\n",
              " 'namespace': ''}"
            ]
          },
          "execution_count": 41,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "query = \"Does ibuprofen increase perioperative blood loss during hip arthroplasty?\"\n",
        "dense, sparse = encode(query)\n",
        "hdense, hsparse = hybrid_scale(dense, sparse, alpha=0.0)  # pure SPARSE\n",
        "# query\n",
        "xc = index.query(\n",
        "    vector=hdense,\n",
        "    sparse_vector=hsparse,\n",
        "    top_k=2,  # how many results to return\n",
        "    include_metadata=True\n",
        ")\n",
        "xc"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "abkrp4aGOQZ-"
      },
      "source": [
        "Here the term `hip arthroplasty` refers to a hip replacement. Using Splade we get the answer ranked at #1. Let's try with dense:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 42,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ixp0AJGpI0Mo",
        "outputId": "1e821c50-a3ba-4dc7-c0cc-b12363469a83"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "{'matches': [{'id': '12442934-3',\n",
              "              'metadata': {'context': ' The perioperative blood loss increased '\n",
              "                                      'by 45% in the ibuprofen group compared '\n",
              "                                      'with placebo. The total (+/-SD) blood '\n",
              "                                      'loss in the ibuprofen group was 1161 '\n",
              "                                      '(+/-472) mL versus 796 (+/-337) mL in '\n",
              "                                      'the placebo group.'},\n",
              "              'score': 177.40633,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []},\n",
              "             {'id': '12442934-0',\n",
              "              'metadata': {'context': 'To determine whether prior exposure of '\n",
              "                                      'non-steroidal anti-inflammatory drugs '\n",
              "                                      'increases perioperative blood loss '\n",
              "                                      'associated with major orthopaedic '\n",
              "                                      'surgery. Fifty patients scheduled for '\n",
              "                                      'total hip replacement were allocated to '\n",
              "                                      'two groups (double blind, randomized '\n",
              "                                      'manner). All patients were pretreated '\n",
              "                                      'for 2 weeks before surgery: Group 1 '\n",
              "                                      'with placebo drug, Group 2 with '\n",
              "                                      'ibuprofen. All patients were injected '\n",
              "                                      'intrathecally with bupivacaine 20mg '\n",
              "                                      'plus morphine 0.'},\n",
              "              'score': 176.02664,\n",
              "              'sparse_values': {'indices': [], 'values': []},\n",
              "              'values': []}],\n",
              " 'namespace': ''}"
            ]
          },
          "execution_count": 42,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "query = \"Does ibuprofen increase perioperative blood loss during hip arthroplasty?\"\n",
        "dense, sparse = encode(query)\n",
        "hdense, hsparse = hybrid_scale(dense, sparse, alpha=1.0)  # pure DENSE\n",
        "# query\n",
        "xc = index.query(\n",
        "    vector=hdense,\n",
        "    sparse_vector=hsparse,\n",
        "    top_k=2,  # how many results to return\n",
        "    include_metadata=True\n",
        ")\n",
        "xc"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "swPFSFnbOqKI"
      },
      "source": [
        "Using dense only we still get the \"best\" answer at #2, but we return a less relevant answer first. For this question and others, SLADE can outperform dense models, particularly those that haven't been fine-tuned on the data source.\n",
        "\n",
        "Naturally, searching with both sparse and dense can give us the best of both worlds. We give important to keyword matches, without losing the semantic meaning component."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "au1yYsr4JoAS"
      },
      "source": [
        "Try some more questions!\n",
        "\n",
        "Here are a few ideas [sourced from the PubMedQA paper](https://aclanthology.org/D19-1259/):\n",
        "\n",
        "```\n",
        "Do preoperative statins reduce atrial fibrillation after coronary artery bypass grafting?\n",
        "\n",
        "Spontaneous electrocardiogram alterations predict ventricular fibrillation in Brugada syndrome\n",
        "\n",
        "Do liver grafts from selected older donors have significantly more ischaemia reperfusion injury?\n",
        "\n",
        "Does reducing spasticity translate into functional benefit?\n",
        "\n",
        "Does ibuprofen increase perioperative blood loss during hip arthroplasty?\n",
        "\n",
        "Should circumcision be performed in childhood?\n",
        "\n",
        "Is external palliative radiotherapy for gallbladder carcinoma effective?\n",
        "\n",
        "Sternal fracture in growing children: A rare and often overlooked fracture?\n",
        "\n",
        "Xanthogranulomatous cholecystitis: a premalignant condition?\n",
        "\n",
        "Can PRISM predict length of PICU stay?\n",
        "\n",
        "Is trabecular bone related to primary stability of miniscrews?\n",
        "```\n",
        "\n",
        "Once you're done, delete the index to save resources."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 43,
      "metadata": {
        "id": "cRSoIhiCIyDv"
      },
      "outputs": [],
      "source": [
        "pinecone.delete_index(index_name)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "nK6bctj_Pc-y"
      },
      "source": [
        "---"
      ]
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "provenance": []
    },
    "gpuClass": "standard",
    "kernelspec": {
      "display_name": "Python 3.9.12 ('ml')",
      "language": "python",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.9.12"
    },
    "orig_nbformat": 4,
    "vscode": {
      "interpreter": {
        "hash": "b8e7999f96e1b425e2d542f21b571f5a4be3e97158b0b46ea1b2500df63956ce"
      }
    },
    "widgets": {
      "application/vnd.jupyter.widget-state+json": {
        "008dafcf3f4d4cdea2913aa0404c3fff": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "01fa7ac790184cf597c4edef864fa73e": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_85cbc3aa2ee24745adc1442f3a15765b",
            "placeholder": "​",
            "style": "IPY_MODEL_d025a12f92974da4b5ac6a22d5175260",
            "value": "Downloading (…)cial_tokens_map.json: 100%"
          }
        },
        "023ea10fe4f64f4986f31c485fb10c97": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0253e0fb8ba449f1abec1d36b1f56db7": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_661995aa2b3e4ef5b751176e00f55ff2",
            "placeholder": "​",
            "style": "IPY_MODEL_a4d5c2ce030749ed9e0208b16e539a2f",
            "value": "Downloading (…)50dc78df09/vocab.txt: 100%"
          }
        },
        "0480c4cacd9e47b59ffda9eafd36bd08": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0707d55c26a2422b8fc6026977ec375d": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_8811eb1476a5467a9e31d857938636af",
              "IPY_MODEL_672de802b2dd4cac86df4dbccf2b3447",
              "IPY_MODEL_9b0f15cf08e64b9b964610a51788b005"
            ],
            "layout": "IPY_MODEL_c7ee3e2badcd438db882c1b3256a696b"
          }
        },
        "08a2ffd39fc9426da48c34853b8b9e23": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0d8be54206934cde81362c3edce7a203": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d34f209c9fa1454786548522de626dfd",
            "placeholder": "​",
            "style": "IPY_MODEL_7a6d4b89a7134e90beb0e6935eac8de1",
            "value": "Downloading (…)50dc78df09/README.md: 100%"
          }
        },
        "100ee9c486784b03bab6a7125a82e030": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "11c6c75c6db44f83ba80ba68ce32c984": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "15180c5bcd244dbaa6f24c7078a8a08e": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "18cb39937cbc459483be4cbbdc45d3be": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "1c248783dc014d109e1690bd1d118209": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1d341f37095642ff86223b75e63aed12": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_38ee783b28e6420894b6f51855357994",
            "placeholder": "​",
            "style": "IPY_MODEL_5639c46a9f094f94a3e7df7c7e4344f3",
            "value": " 461/461 [00:00&lt;00:00, 17.6kB/s]"
          }
        },
        "1dd8820ab04d4f77a5de56954ace800d": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2ebb509f44de4e89a826dfab35b73912",
            "placeholder": "​",
            "style": "IPY_MODEL_dffb230f3bf44bf999f7ae3ea8cbbf86",
            "value": " 54.0/54.0 [00:00&lt;00:00, 1.73kB/s]"
          }
        },
        "20e62440b2704ccd9fe905f34b87a855": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_aaf9ebffe5d44165b906b0f8527c1baa",
              "IPY_MODEL_c1a53019f20c43f5adcde4a372f96520",
              "IPY_MODEL_8811aafcec354de9b4d63b09604ac4ee"
            ],
            "layout": "IPY_MODEL_dfa283eae24349e48a5a55c130c7fdb6"
          }
        },
        "248b940a35b244bca04307f8a167eb9d": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2664606eb5634031a4b10b47dfff2439": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "27065abbc058425fb8688de485fd5938": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_57c534cfe99a41e6a97bdfa5e39caadb",
              "IPY_MODEL_373441f356d642d98a49fc11de58d27c",
              "IPY_MODEL_e75365b51ed14b0b90a93e261eff249c"
            ],
            "layout": "IPY_MODEL_2664606eb5634031a4b10b47dfff2439"
          }
        },
        "2758d0cfb32b4996b6a2738f5c4fe459": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "2a6ce84338dd4e718aee68ed2681ee84": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2e46e31e5e0d4d4797e0cc9677b35e36": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2ebb509f44de4e89a826dfab35b73912": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "302e721a7ad74be38870e336711fce08": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "31f3fa86ec214d92818b19916a97e5cb": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3362fdfb00dd4b4982e32b769ec66a70": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "35692560ec5b4e1082704329b3dbab20": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "36353656c0104708877a51120f9d0a25": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "373441f356d642d98a49fc11de58d27c": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_95bb83589a07473c91960eabfe4fe89e",
            "max": 466248,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_15180c5bcd244dbaa6f24c7078a8a08e",
            "value": 466248
          }
        },
        "385292032a63480e85041b6e769e7ce3": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "38ea675129d448c9aeb19fdf0305585c": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "38ee783b28e6420894b6f51855357994": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3a687d3d829a4da3b6cf59d741947229": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_eda56a13387340b99e23c711d402bb74",
            "placeholder": "​",
            "style": "IPY_MODEL_970f37cbf3544832b72ace0299874ce2",
            "value": " 438M/438M [00:02&lt;00:00, 181MB/s]"
          }
        },
        "401bf63e5b9d4b91ae39544bd6d38d51": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_505038936c104b5eb3fcd833d54d5995",
            "max": 190,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_638b7900353b454a9505d0bbfedaab00",
            "value": 190
          }
        },
        "401f51dfdd1b41eb99fb423d31131890": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4244ebb614e34ad19f5db5349e713b31": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "49d309d766474ca7bd6b063bccdc2f07": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4b31cb7b15a6475fadd8d9e97287b08b": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "4cb1b687d5a84e7eb649ee76d647e191": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "505038936c104b5eb3fcd833d54d5995": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "53962eaaca764fe6866774a3e0d1df6e": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "54154b81da834cbc9bf8ccf5ee81d499": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ae45bc8a2fbe43679943bd18206c6421",
              "IPY_MODEL_e4f6aa98f3a44fd3a80a2b9c366a6f2f",
              "IPY_MODEL_f128e2ef1c384872812ebb7f112b96c9"
            ],
            "layout": "IPY_MODEL_6a556aad931647d58a4c5018c6737efd"
          }
        },
        "5639c46a9f094f94a3e7df7c7e4344f3": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "57c3db7d225e4a428e8d9598ff25ecd9": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "57c534cfe99a41e6a97bdfa5e39caadb": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_35692560ec5b4e1082704329b3dbab20",
            "placeholder": "​",
            "style": "IPY_MODEL_efac14825157470d8008320e1eb509f8",
            "value": "Downloading (…)8df09/tokenizer.json: 100%"
          }
        },
        "58344458edd649c5b0ac67882d2dc727": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "5841654c6dbf40b282a5d7359abcbfd5": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_36353656c0104708877a51120f9d0a25",
            "max": 116,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_a94fa31c93d64c06aadab8cb74306623",
            "value": 116
          }
        },
        "5982dcf51d7f40ae9677e5b9468eade2": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "5c9e8d6733ad461188b01974e04357cd": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_1c248783dc014d109e1690bd1d118209",
            "max": 1175,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_008dafcf3f4d4cdea2913aa0404c3fff",
            "value": 1175
          }
        },
        "5ca93a5ada074119bf5c6cde3b9d225a": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_302e721a7ad74be38870e336711fce08",
            "placeholder": "​",
            "style": "IPY_MODEL_b34842fab0164d1394b855050e7c7629",
            "value": " 190/190 [00:00&lt;00:00, 3.04kB/s]"
          }
        },
        "5fad4aa44f16407dab7a6d664e8ac519": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "618d0a2a375444a38a3e11bcd093dd74": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_53962eaaca764fe6866774a3e0d1df6e",
            "placeholder": "​",
            "style": "IPY_MODEL_bab2be3bc99841cea55e6fb68ec21531",
            "value": "Downloading (…)nce_bert_config.json: 100%"
          }
        },
        "638b7900353b454a9505d0bbfedaab00": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "64401e084e42476cb968dac167e7778a": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_8ed2da8d35f543e4aff82f8a0622ad99",
            "placeholder": "​",
            "style": "IPY_MODEL_9bb05b4768214e3a8291dbecf900cb9b",
            "value": " 112/112 [00:00&lt;00:00, 4.93kB/s]"
          }
        },
        "661995aa2b3e4ef5b751176e00f55ff2": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "667164d334b040899b99304164c6ed01": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "672de802b2dd4cac86df4dbccf2b3447": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c345b55c35ea4ca69ce3e1d4ac6f9dca",
            "max": 636,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_e9b0b9d36f2c41d198d37249c2ce76b2",
            "value": 636
          }
        },
        "68ad6d83eb4943459b6cf6898a45c656": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "6a556aad931647d58a4c5018c6737efd": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6b97a667ec864b789f30f9d99b0a20ba": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2758d0cfb32b4996b6a2738f5c4fe459",
            "max": 461,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_68ad6d83eb4943459b6cf6898a45c656",
            "value": 461
          }
        },
        "6ba628998ca240c5bfe4fb21dcd3d9e7": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_e7fb930778c84d4f9c4306960b4f565e",
              "IPY_MODEL_5c9e8d6733ad461188b01974e04357cd",
              "IPY_MODEL_7917091668aa4f0f849b146b1054b37c"
            ],
            "layout": "IPY_MODEL_b24cca6c1f6a46c3a79f7a78927aac84"
          }
        },
        "6bd3bcc7f1994bf88ecf0eeba3995646": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_72ed4745dc504191b5bca7da50db8f0f",
            "max": 112,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_bcaea55ddaa943bcbe3091aefbbc73d4",
            "value": 112
          }
        },
        "705be08a46a340bfb3a8183475ca84a4": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_401f51dfdd1b41eb99fb423d31131890",
            "placeholder": "​",
            "style": "IPY_MODEL_bb299d8a33dc43dd8db2c0e8a52e4975",
            "value": "Downloading (…)ce_transformers.json: 100%"
          }
        },
        "72ed4745dc504191b5bca7da50db8f0f": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "75bc1c6846ce490db7eb62592dbd6995": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_a4e4c78e17f24825852b3e91a8387afd",
              "IPY_MODEL_dc38e44bd7ff4cd7b0167fbc01068881",
              "IPY_MODEL_3a687d3d829a4da3b6cf59d741947229"
            ],
            "layout": "IPY_MODEL_100ee9c486784b03bab6a7125a82e030"
          }
        },
        "772e69f9af5a4a4aa9721c9bac340b70": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_96b38acbb714419e8e1ac4ec5f168431",
            "placeholder": "​",
            "style": "IPY_MODEL_3362fdfb00dd4b4982e32b769ec66a70",
            "value": "Downloading (…)c78df09/modules.json: 100%"
          }
        },
        "780d138b62af4ad1a1b6589b66f06e34": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7917091668aa4f0f849b146b1054b37c": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_fce9f49dec7b4d699c686d7b4d16f1a9",
            "placeholder": "​",
            "style": "IPY_MODEL_98ef5f33296d4d80bfc2c1ccd0c18b03",
            "value": " 1.18k/1.18k [00:00&lt;00:00, 17.2kB/s]"
          }
        },
        "794bc768bbbf481c8ef1d9fc84c46439": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0480c4cacd9e47b59ffda9eafd36bd08",
            "max": 229,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_58344458edd649c5b0ac67882d2dc727",
            "value": 229
          }
        },
        "7a347ba2c05f4737b44b252706d723d3": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7a6d4b89a7134e90beb0e6935eac8de1": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "804cc5554212478f8dd594c2a9e49507": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "815a6af34b16418895c3fd270c4c594c": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "81c773ff410545bbbb213e9581e600b2": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_0d8be54206934cde81362c3edce7a203",
              "IPY_MODEL_9faa2bee5528421891a9e12db86c9bac",
              "IPY_MODEL_a6f24917244a413c8c817f03bd7791c3"
            ],
            "layout": "IPY_MODEL_a9fa6be400354573845f92f3e84b0780"
          }
        },
        "85cbc3aa2ee24745adc1442f3a15765b": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8811aafcec354de9b4d63b09604ac4ee": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_fb5d3cfa047541e3b4d876d8f8987956",
            "placeholder": "​",
            "style": "IPY_MODEL_d52986695b2b4acf807e7d8f5b4e84ce",
            "value": " 93/93 [01:30&lt;00:00,  1.16it/s]"
          }
        },
        "8811eb1476a5467a9e31d857938636af": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f070e8aee0f14c1fb365713486aabfa7",
            "placeholder": "​",
            "style": "IPY_MODEL_5982dcf51d7f40ae9677e5b9468eade2",
            "value": "Downloading (…)dc78df09/config.json: 100%"
          }
        },
        "8dc531d28e574fecbe6faecf88bd6fe3": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8ed2da8d35f543e4aff82f8a0622ad99": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "95bb83589a07473c91960eabfe4fe89e": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "96b38acbb714419e8e1ac4ec5f168431": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "970f37cbf3544832b72ace0299874ce2": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "98ef5f33296d4d80bfc2c1ccd0c18b03": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "997127047843496d9a65733660c8566a": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_0253e0fb8ba449f1abec1d36b1f56db7",
              "IPY_MODEL_b8fce2cce0ba43e8b7188eb0eed5caf3",
              "IPY_MODEL_d85747a3e1f04591ab99818ca9a07de8"
            ],
            "layout": "IPY_MODEL_e276fdc557b9414b819dc55aedba3796"
          }
        },
        "9b0f15cf08e64b9b964610a51788b005": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7a347ba2c05f4737b44b252706d723d3",
            "placeholder": "​",
            "style": "IPY_MODEL_dbbe12f80277472fa1b0e1a64687f26d",
            "value": " 636/636 [00:00&lt;00:00, 26.6kB/s]"
          }
        },
        "9bb05b4768214e3a8291dbecf900cb9b": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "9e9b9223b4994473aeb4b89a9abdd099": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "9ee275dcd80947fbad2c3bf510be805a": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "9efb60c3718a44a888ff2146f5a7ae99": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "9f4ff4035e2340cf98e8d4a316dc1fdd": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "9faa2bee5528421891a9e12db86c9bac": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_667164d334b040899b99304164c6ed01",
            "max": 6141,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_ed40c14aee87414798520105749ae4a2",
            "value": 6141
          }
        },
        "a357263581434d0eba5828dd57dd39e1": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a44201037dfc4a2e9c01fe2900cc13b4": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a4d5c2ce030749ed9e0208b16e539a2f": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a4e4c78e17f24825852b3e91a8387afd": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_804cc5554212478f8dd594c2a9e49507",
            "placeholder": "​",
            "style": "IPY_MODEL_ed09d111b20d45438f69f8022c733005",
            "value": "Downloading (…)&quot;pytorch_model.bin&quot;;: 100%"
          }
        },
        "a6f24917244a413c8c817f03bd7791c3": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_b9e3fb3fda954649a8eac06bc0d3739f",
            "placeholder": "​",
            "style": "IPY_MODEL_5fad4aa44f16407dab7a6d664e8ac519",
            "value": " 6.14k/6.14k [00:00&lt;00:00, 302kB/s]"
          }
        },
        "a7253c09584b411e8f5ac4ee7f69f320": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a94fa31c93d64c06aadab8cb74306623": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "a9fa6be400354573845f92f3e84b0780": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "aaf9ebffe5d44165b906b0f8527c1baa": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_38ea675129d448c9aeb19fdf0305585c",
            "placeholder": "​",
            "style": "IPY_MODEL_4b31cb7b15a6475fadd8d9e97287b08b",
            "value": "100%"
          }
        },
        "ab18f54679d04352b9aba78976ddfc06": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "ae45bc8a2fbe43679943bd18206c6421": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_385292032a63480e85041b6e769e7ce3",
            "placeholder": "​",
            "style": "IPY_MODEL_2a6ce84338dd4e718aee68ed2681ee84",
            "value": "Downloading (…)df09/train_script.py: 100%"
          }
        },
        "af3a50e6344e4382aae3741683d92b9b": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b029e593f18f4e0586282fc4aaedd320": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b24cca6c1f6a46c3a79f7a78927aac84": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b34842fab0164d1394b855050e7c7629": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b8fce2cce0ba43e8b7188eb0eed5caf3": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_11c6c75c6db44f83ba80ba68ce32c984",
            "max": 231508,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_ab18f54679d04352b9aba78976ddfc06",
            "value": 231508
          }
        },
        "b9daec2576c8463a9871f4b8216b9689": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b9e3fb3fda954649a8eac06bc0d3739f": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "bab2be3bc99841cea55e6fb68ec21531": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "babce43296d24378896c1a3fa4713720": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_af3a50e6344e4382aae3741683d92b9b",
            "placeholder": "​",
            "style": "IPY_MODEL_b9daec2576c8463a9871f4b8216b9689",
            "value": "Downloading (…)_Pooling/config.json: 100%"
          }
        },
        "bb299d8a33dc43dd8db2c0e8a52e4975": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "bcaea55ddaa943bcbe3091aefbbc73d4": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "be91e29fcdfd4307a519da3931f6b943": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c1a53019f20c43f5adcde4a372f96520": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_023ea10fe4f64f4986f31c485fb10c97",
            "max": 93,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_9e9b9223b4994473aeb4b89a9abdd099",
            "value": 93
          }
        },
        "c345b55c35ea4ca69ce3e1d4ac6f9dca": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c358b9b8ee434884a56550f91965e22f": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c3c37de68162425cbe03a97991492bcd": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a357263581434d0eba5828dd57dd39e1",
            "placeholder": "​",
            "style": "IPY_MODEL_815a6af34b16418895c3fd270c4c594c",
            "value": "Downloading (…)okenizer_config.json: 100%"
          }
        },
        "c781fa3427604455b30eff5b8d342083": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_c3c37de68162425cbe03a97991492bcd",
              "IPY_MODEL_6b97a667ec864b789f30f9d99b0a20ba",
              "IPY_MODEL_1d341f37095642ff86223b75e63aed12"
            ],
            "layout": "IPY_MODEL_f1540fcc2eb34c7aa3dd6c5f311e36cd"
          }
        },
        "c7ee3e2badcd438db882c1b3256a696b": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c9f0b97472cd407ea18f716b542bf225": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_705be08a46a340bfb3a8183475ca84a4",
              "IPY_MODEL_5841654c6dbf40b282a5d7359abcbfd5",
              "IPY_MODEL_d06bfaa357bf4719a0ef897619101c56"
            ],
            "layout": "IPY_MODEL_9f4ff4035e2340cf98e8d4a316dc1fdd"
          }
        },
        "ca810cd480204fa0bcf7d62e8ffdddea": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "cca9c1fb2775425db3bb36bbbb3fd310": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c358b9b8ee434884a56550f91965e22f",
            "max": 54,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_dccca4d25a0a445cbf9431be996439a0",
            "value": 54
          }
        },
        "cfa28c0142b04d35952dc53d0b1dba9c": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d025a12f92974da4b5ac6a22d5175260": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d053563876ea4d7c8d25c88a63df9829": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_babce43296d24378896c1a3fa4713720",
              "IPY_MODEL_401bf63e5b9d4b91ae39544bd6d38d51",
              "IPY_MODEL_5ca93a5ada074119bf5c6cde3b9d225a"
            ],
            "layout": "IPY_MODEL_49d309d766474ca7bd6b063bccdc2f07"
          }
        },
        "d06bfaa357bf4719a0ef897619101c56": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_8dc531d28e574fecbe6faecf88bd6fe3",
            "placeholder": "​",
            "style": "IPY_MODEL_18cb39937cbc459483be4cbbdc45d3be",
            "value": " 116/116 [00:00&lt;00:00, 5.19kB/s]"
          }
        },
        "d34f209c9fa1454786548522de626dfd": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d52986695b2b4acf807e7d8f5b4e84ce": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d85747a3e1f04591ab99818ca9a07de8": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_be91e29fcdfd4307a519da3931f6b943",
            "placeholder": "​",
            "style": "IPY_MODEL_9efb60c3718a44a888ff2146f5a7ae99",
            "value": " 232k/232k [00:00&lt;00:00, 1.96MB/s]"
          }
        },
        "dbbe12f80277472fa1b0e1a64687f26d": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "dc38e44bd7ff4cd7b0167fbc01068881": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_cfa28c0142b04d35952dc53d0b1dba9c",
            "max": 438015479,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_57c3db7d225e4a428e8d9598ff25ecd9",
            "value": 438015479
          }
        },
        "dccca4d25a0a445cbf9431be996439a0": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "dd6773b4630d409383e8602ee485f7c4": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_618d0a2a375444a38a3e11bcd093dd74",
              "IPY_MODEL_cca9c1fb2775425db3bb36bbbb3fd310",
              "IPY_MODEL_1dd8820ab04d4f77a5de56954ace800d"
            ],
            "layout": "IPY_MODEL_4244ebb614e34ad19f5db5349e713b31"
          }
        },
        "dfa283eae24349e48a5a55c130c7fdb6": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "dffb230f3bf44bf999f7ae3ea8cbbf86": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e276fdc557b9414b819dc55aedba3796": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e4f6aa98f3a44fd3a80a2b9c366a6f2f": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "FloatProgressModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_08a2ffd39fc9426da48c34853b8b9e23",
            "max": 10351,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_e583a55ffbef4361aed9ce8fdd99eab6",
            "value": 10351
          }
        },
        "e583a55ffbef4361aed9ce8fdd99eab6": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "e75365b51ed14b0b90a93e261eff249c": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_31f3fa86ec214d92818b19916a97e5cb",
            "placeholder": "​",
            "style": "IPY_MODEL_b029e593f18f4e0586282fc4aaedd320",
            "value": " 466k/466k [00:00&lt;00:00, 3.32MB/s]"
          }
        },
        "e7fb930778c84d4f9c4306960b4f565e": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a44201037dfc4a2e9c01fe2900cc13b4",
            "placeholder": "​",
            "style": "IPY_MODEL_4cb1b687d5a84e7eb649ee76d647e191",
            "value": "Downloading (…)8df09/.gitattributes: 100%"
          }
        },
        "e9b0b9d36f2c41d198d37249c2ce76b2": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "ec726dfd105640c2b9e5a4ca55dab8b8": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_01fa7ac790184cf597c4edef864fa73e",
              "IPY_MODEL_6bd3bcc7f1994bf88ecf0eeba3995646",
              "IPY_MODEL_64401e084e42476cb968dac167e7778a"
            ],
            "layout": "IPY_MODEL_ca810cd480204fa0bcf7d62e8ffdddea"
          }
        },
        "ed09d111b20d45438f69f8022c733005": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "ed40c14aee87414798520105749ae4a2": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "ProgressStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "eda56a13387340b99e23c711d402bb74": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "efac14825157470d8008320e1eb509f8": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "DescriptionStyleModel",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "f070e8aee0f14c1fb365713486aabfa7": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f128e2ef1c384872812ebb7f112b96c9": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_780d138b62af4ad1a1b6589b66f06e34",
            "placeholder": "​",
            "style": "IPY_MODEL_2e46e31e5e0d4d4797e0cc9677b35e36",
            "value": " 10.4k/10.4k [00:00&lt;00:00, 399kB/s]"
          }
        },
        "f1540fcc2eb34c7aa3dd6c5f311e36cd": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f4c22c20e36848acafab7a1021430377": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HTMLModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a7253c09584b411e8f5ac4ee7f69f320",
            "placeholder": "​",
            "style": "IPY_MODEL_248b940a35b244bca04307f8a167eb9d",
            "value": " 229/229 [00:00&lt;00:00, 11.8kB/s]"
          }
        },
        "f7bb49c411a647eeb806e4ecde1726e1": {
          "model_module": "@jupyter-widgets/controls",
          "model_module_version": "1.5.0",
          "model_name": "HBoxModel",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_772e69f9af5a4a4aa9721c9bac340b70",
              "IPY_MODEL_794bc768bbbf481c8ef1d9fc84c46439",
              "IPY_MODEL_f4c22c20e36848acafab7a1021430377"
            ],
            "layout": "IPY_MODEL_9ee275dcd80947fbad2c3bf510be805a"
          }
        },
        "fb5d3cfa047541e3b4d876d8f8987956": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fce9f49dec7b4d699c686d7b4d16f1a9": {
          "model_module": "@jupyter-widgets/base",
          "model_module_version": "1.2.0",
          "model_name": "LayoutModel",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        }
      }
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}
